-- Logs begin at Mon 2022-07-25 19:31:07 UTC, end at Mon 2022-07-25 20:51:39 UTC. -- Jul 25 20:19:28.408572 dv-osbrick-849017-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 20:19:28.424679 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 20:19:28 2022] *** Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: nodename: dv-osbrick-849017-3-ceph Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: machine: x86_64 Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: clock source: unix Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: pcre jit disabled Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: detected number of CPU cores: 4 Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: current working directory: / Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: detected binary path: /usr/bin/uwsgi-core Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: your processes number limit is 47680 Jul 25 20:19:28.427419 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: your memory page size is 4096 bytes Jul 25 20:19:28.428413 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: detected max file descriptor number: 2048 Jul 25 20:19:28.428413 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: lock engine: pthread robust mutexes Jul 25 20:19:28.428413 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: thunder lock: enabled Jul 25 20:19:28.428413 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 20:19:28.428413 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 20:19:28.487527 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: Python main interpreter initialized at 0x5587bb3e49c0 Jul 25 20:19:28.487527 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: python threads support enabled Jul 25 20:19:28.487527 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: your server socket listen backlog is limited to 100 connections Jul 25 20:19:28.487527 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: your mercy for graceful operations on workers is 90 seconds Jul 25 20:19:28.488055 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 20:19:28.488055 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: *** Operational MODE: preforking *** Jul 25 20:19:28.488264 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: *** uWSGI is running in multiple interpreter mode *** Jul 25 20:19:28.488264 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: spawned uWSGI master process (pid: 87195) Jul 25 20:19:28.488370 dv-osbrick-849017-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 20:19:28.489743 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: spawned uWSGI worker 1 (pid: 87207, cores: 1) Jul 25 20:19:28.489743 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: spawned uWSGI worker 2 (pid: 87208, cores: 1) Jul 25 20:19:28.489743 dv-osbrick-849017-3-ceph devstack@keystone.service[87195]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 20:19:34.693920 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 20:19:34.693920 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: from cryptography.utils import int_from_bytes Jul 25 20:19:34.694777 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 20:19:34.694777 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: from cryptography.utils import int_from_bytes Jul 25 20:19:34.738301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 20:19:34.738301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: from cryptography.utils import int_from_bytes Jul 25 20:19:34.739291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 20:19:34.739291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: from cryptography.utils import int_from_bytes Jul 25 20:19:34.748244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 20:19:34.748520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 20:19:34.748666 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] command line args: [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 20:19:34.748870 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 20:19:34.749096 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ================================================================================ {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 20:19:34.749335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] admin_token = **** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.749656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] config_dir = [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.749804 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.750011 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] config_source = [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.750297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] debug = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.751105 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] list_limit = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] log_config_append = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] log_dir = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.753074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] log_file = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.754346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.754346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.754346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.754346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.754346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.754346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.755324 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.755324 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.755324 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.755742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.755742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.756062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.756259 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.756405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.756637 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.757180 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.757622 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] publish_errors = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.757622 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.757965 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.758103 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.758103 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.758691 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.758691 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] standard_threads = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.758953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.759156 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.759390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.759528 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] use_journal = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.759699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] use_json = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.759878 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] use_stderr = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.760056 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] use_syslog = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.760296 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.760693 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.761019 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.761223 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.761496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.761745 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.761988 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.762237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.762475 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.762724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.762974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.763231 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.763466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.763715 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.763949 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.764197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.764447 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.764682 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.764939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.765239 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.765490 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.765727 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.765992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.766829 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.767165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.767465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.767806 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.768049 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.768282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.768520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.768772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.769003 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.769266 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.769500 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.769748 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.770005 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.770225 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.770474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.770706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.770944 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.771179 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.771410 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.771636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.771859 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.772089 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.772366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.772659 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.772898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.773165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.773400 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.773633 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.773865 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.774112 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.774345 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.774583 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.774823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.775066 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.775299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.775534 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.775978 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.775978 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.776260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.776455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.776687 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.776948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.777191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.777425 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.777745 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.777883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.778166 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.778391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.778610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.778865 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.779105 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.779500 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.779500 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.779800 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.780001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.780213 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.780449 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.780685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.780921 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.781255 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.781440 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.781656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.781933 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.782280 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.782550 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.782909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.783160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.783404 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.783643 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.783885 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.784119 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.784350 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.784581 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.784823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.785056 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.785328 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.785568 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.785820 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.786058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.786463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.786729 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.786974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.787209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] auth.external = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.787441 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.787752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.787988 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.788222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] auth.password = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.788453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] auth.token = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.788697 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.788933 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.789214 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.789629 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.789893 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.790182 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 20:19:34.790420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.790567 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 20:19:34.790896 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.791047 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] command line args: [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 20:19:34.791244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] credential.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.791378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 20:19:34.791501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.791617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ================================================================================ {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 20:19:34.791909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.792061 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] admin_token = **** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.792201 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.792516 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] config_dir = [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.792516 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.792779 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.792910 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] config_source = [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.793300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.793436 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] debug = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.793570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.793709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.793709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.793994 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.794125 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.794447 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.794595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.794737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.794901 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.795100 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.795273 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] list_limit = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.795441 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.795774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] log_config_append = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.795774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.796101 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.796320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] log_dir = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.796579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.796832 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] log_file = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.796832 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.797093 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.797287 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.797439 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.797439 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] federation.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.797691 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.797691 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.797942 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.798087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.798087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.798387 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.798387 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.798634 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.798787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.798915 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.799286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.799425 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.799568 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.799704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.799704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.799981 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.800128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.800256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.800384 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.800517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.800652 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.800781 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.800927 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.801062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.801062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.801411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.801411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] publish_errors = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.801674 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.801809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.801809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.802048 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.802179 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.802330 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.802464 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.802604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.802747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.802890 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.803030 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] standard_threads = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.803177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.803312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.803444 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.803576 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.803576 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.803825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.803971 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] use_journal = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.804103 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.804237 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] use_json = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.804369 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.804502 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] use_stderr = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.804630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.804777 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] use_syslog = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.804897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.805074 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:19:34.805253 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.805253 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.805563 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.805743 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.805743 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.806038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.806327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.806327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.806586 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.807089 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.807224 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.807357 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.807491 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.807631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.807762 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.807913 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.807913 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.808170 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.808300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.808445 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.808579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.808706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.808847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.808985 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.809157 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.809309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.809438 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.809571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.809713 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.809846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.809982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.810116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.810248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.810379 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.810379 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.810638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.810773 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.810905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.811039 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.811172 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.811319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.811462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.811597 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.811740 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.811868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.811998 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.812150 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.812283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.812425 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.812569 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.812704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.813552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.813552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.813766 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.813895 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.814075 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.814075 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.814335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.814471 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.814602 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.814602 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.814859 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.814992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.815135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.815269 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.815403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.815550 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.815685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.815817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.815949 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.816144 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.816278 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.816425 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.816557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.816690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.816822 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.816953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.817089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.817275 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.817411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.817543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.817678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.817809 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.817943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.818094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.818231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.818365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.818499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.818631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.818779 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.818916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.819050 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.819182 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.819314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.819445 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.819585 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.819711 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.819839 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.819971 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.820107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.820242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.820389 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.820520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.820652 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.820795 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.820920 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.821059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.821232 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.821365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.821506 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.821677 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.821812 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.821950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.822266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.822406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.822540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.822658 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.822776 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.822912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.823250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.823391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.823526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.823660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.823796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.823927 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.824169 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.824304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.824436 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.824571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.824705 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.824855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.825001 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.825247 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.825384 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.825518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.825651 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.825786 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.825948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.826083 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.826218 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.826354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.826489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.826621 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.826771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.826904 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.827033 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.827167 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] resource.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.827302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.827435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.827578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.827711 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.827844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.827979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.828113 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.828243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.828388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.828583 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.829241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.829387 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.829525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.829661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.829833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.829969 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.830099 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.830232 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.830354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.830354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.830596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] role.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.830728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.830857 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] role.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.830980 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.831123 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.831257 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.831395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.831526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.831665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.831795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.831924 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.832054 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.832197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.832329 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.832462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.832593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.832718 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.832987 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.833432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.833571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.833717 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.834024 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.834168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.834300 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.834445 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.834580 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.834707 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.834835 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.835148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.835282 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.835422 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.835764 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.835764 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.836009 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.836321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.836466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.836616 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.836752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.836899 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.837028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.837180 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.837329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.837442 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.837561 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.837694 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] auth.external = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.837827 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.837953 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.838098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.838098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.838320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.838440 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.838557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.838675 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.838807 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] auth.password = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.839130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.839256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] auth.token = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.839372 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.839478 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.839478 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.839697 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.839831 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.840147 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.840270 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.840270 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.840695 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.840695 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.840958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.841092 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.841092 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.841448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.841581 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] token.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.841730 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] credential.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.841861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.841991 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.842124 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.842276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.842409 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.842557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.842686 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.842816 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.842947 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.843089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.843223 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.843372 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.843509 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.843640 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.843769 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.843895 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.844022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.844700 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.844834 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.844964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.845080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.845080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.845321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.845690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.845810 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.845943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.846256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.846378 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.846493 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.846620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.846732 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.846837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.846940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] federation.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.846940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.847142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.connection = **** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.847275 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.847407 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.847524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.847638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.847751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.847874 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848008 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848153 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848417 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848547 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848663 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848781 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.848932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.849279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.849410 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.849556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.849685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.850792 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.850942 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.851077 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.851211 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.851375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.851497 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.851630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.851749 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.851869 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.851990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.852108 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.852377 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.852519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.852635 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.852753 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.852870 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.852985 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.853276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.854141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.855904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.856763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.858817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.860589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.861738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] resource.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.862617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.863592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] role.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.863592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] role.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.863592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.863592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.863592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.864309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.864309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.864309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.864655 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.864655 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.864883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.865160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.865420 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.865674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.865934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.866188 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.866631 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.866870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.867126 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.867380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.867633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.867970 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.868213 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.868414 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.868612 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.868839 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.869078 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.869322 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.869540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.869803 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.870064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.870318 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.870562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.870800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.871037 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.871324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] token.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.871513 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.871767 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.872006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.872270 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.872521 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.872765 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.873013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.873283 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.873538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.873776 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.874020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.874259 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.874521 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.874773 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.875007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.875254 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.876228 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.876611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.connection = **** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.877024 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.877318 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.877521 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.877720 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.877918 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.878113 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.878324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.878518 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.878712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.878951 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.879216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.879457 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.879665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.879756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.879821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.879935 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.880023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.880183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.880418 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.880665 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.880905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:19:34.881079 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 20:19:34.888850 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.908416 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.908657 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.908899 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.920112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.923474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.923695 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.952936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.953281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:34.981573 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.018753 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.037884 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.038126 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.060199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.060592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.115708 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.116073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.116273 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.116418 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.116653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.116843 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.116988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.117164 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.117361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.117551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.117745 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.117745 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.143350 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.143639 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.143807 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.144017 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.144245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.144465 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.144687 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.145938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.146169 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.146386 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.146707 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.146905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.147092 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.147310 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.158801 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.159175 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.173408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.173760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.173978 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.174182 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.174426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.174639 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.174847 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.175055 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.175285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.175491 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.175711 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.175923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.175923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.176326 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 20:19:35.194287 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.194670 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 20:19:35.194831 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.195041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 20:19:35.195363 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.195626 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.195894 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.196199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.196320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.196426 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 20:19:35.196657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.196895 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 20:19:35.197337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.197693 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.197998 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.198262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.207111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.207365 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.207535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.207837 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.209299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.209598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.209865 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.210151 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.216996 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.219852 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.220693 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.220986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.221295 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.221584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.221868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.222127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.222395 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.222662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.222943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.223224 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.223351 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.223506 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.223628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.223881 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.224162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.224444 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.224701 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.224964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.225262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.225534 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.225813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.226077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.247382 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.248967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.249279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.249864 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.251638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.252250 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.254414 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.254953 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.254953 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.256976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.257305 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.257714 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.261995 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.262175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.264392 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.264685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.267040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.267511 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.267823 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.268112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.268390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.268793 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.269067 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.269368 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.269628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.269932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.270320 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.270797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.271109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.271394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.271673 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.271954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.286298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.286580 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.289932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.290228 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.290675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.294063 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.294374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.294878 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.299001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.299446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.299634 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.302849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.304137 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.306172 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.306486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.307022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.307320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.307610 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.307760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.308019 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.311216 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.311571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.311825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.312234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.312637 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.313033 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.326646 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.327074 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.327262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.327461 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.330713 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.331015 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.331288 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.331552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.337493 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.339203 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.340215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.340712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.341526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.341806 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.345778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.346135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.346429 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.346699 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.346954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.347078 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.347196 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.347674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.348190 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.348666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.359083 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.359376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.359659 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.360506 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.360968 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.361273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.361560 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.364205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.364499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.364787 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.365068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.365382 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.365662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.365945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.379566 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.384880 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.388917 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.393086 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.395616 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.396020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.398374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.398819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.399253 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.403831 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.406693 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.410444 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.410887 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.411303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.561300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.564018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.569260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.569723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.570163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.570588 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.573641 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.576405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.581830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.582299 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.582725 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.583162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.585423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.585891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.586311 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.598672 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.599136 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.599493 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.599585 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.599945 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.600375 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.600799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.601268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.601713 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.602148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.602591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.603036 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.603483 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.603955 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.604395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.604825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.605279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.613015 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 20:19:35.613988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.614127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.614563 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.614988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.615444 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.615890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.616313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.616768 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.617249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.617697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.618290 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.618732 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.619143 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 20:19:35.668347 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5587bb3e49c0 pid: 87208 (default app) Jul 25 20:19:35.675500 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40481bf0-7161-4eb4-9def-c638e5d99113 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:35.675960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40481bf0-7161-4eb4-9def-c638e5d99113 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:35.676415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40481bf0-7161-4eb4-9def-c638e5d99113 None None] PATH_INFO: `/v3` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:35.682813 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5587bb3e49c0 pid: 87207 (default app) Jul 25 20:19:35.684111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Mon Jul 25 20:19:35 2022] GET /identity/v3/ => generated 255 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:19:44.729140 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06cf2-c5c0-496f-a5f5-f2ba9c86715d None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:44.729741 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06cf2-c5c0-496f-a5f5-f2ba9c86715d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:44.730150 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06cf2-c5c0-496f-a5f5-f2ba9c86715d None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:44.739543 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:19:44 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:19:44.749867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:44.751214 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:44.751336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:44.914362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: INFO dbcounter [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] Registered counter for database keystone Jul 25 20:19:44.954589 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG oslo_db.sqlalchemy.engines [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:19:44.966327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writer thread running {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:19:45.224105 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG passlib.handlers.bcrypt [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87208) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 20:19:45.224598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG passlib.handlers.bcrypt [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87208) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 20:19:45.285890 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:19:45.287702 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:19:45.459547 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:19:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 712 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 20:19:45.613653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea06cf2-c5c0-496f-a5f5-f2ba9c86715d None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:45.698080 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: INFO dbcounter [None req-5ea06cf2-c5c0-496f-a5f5-f2ba9c86715d None None] Registered counter for database keystone Jul 25 20:19:45.731403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea06cf2-c5c0-496f-a5f5-f2ba9c86715d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:19:45.740852 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writer thread running {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:19:45.886486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea06cf2-c5c0-496f-a5f5-f2ba9c86715d None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:45.892769 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632ae6a-7ca9-483f-9a78-b0d571592b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:45.893545 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632ae6a-7ca9-483f-9a78-b0d571592b48 admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:45.893870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632ae6a-7ca9-483f-9a78-b0d571592b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:45.894191 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632ae6a-7ca9-483f-9a78-b0d571592b48 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:45.904073 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632ae6a-7ca9-483f-9a78-b0d571592b48 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:45.975193 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c632ae6a-7ca9-483f-9a78-b0d571592b48 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 20:19:45.975834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632ae6a-7ca9-483f-9a78-b0d571592b48 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:45.992434 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Jul 25 20:19:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 20:19:46.004015 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:46.023579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf4ed9-21d9-4a93-b4c3-0b9b328727b5 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:46.029754 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc985e7-6f25-4afd-aba0-8b57814b9ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:46.038132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc985e7-6f25-4afd-aba0-8b57814b9ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:46.038587 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc985e7-6f25-4afd-aba0-8b57814b9ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:46.038978 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc985e7-6f25-4afd-aba0-8b57814b9ec4 admin admin] PATH_INFO: `/v3/projects/29a02beb75e24b5ebbb64e25721c9c99` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:46.041034 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc985e7-6f25-4afd-aba0-8b57814b9ec4 admin admin] RBAC: Authorizing `identity:get_project(project_id=29a02beb75e24b5ebbb64e25721c9c99)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:46.111158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7bc985e7-6f25-4afd-aba0-8b57814b9ec4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 20:19:46.111751 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc985e7-6f25-4afd-aba0-8b57814b9ec4 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:46.121797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Mon Jul 25 20:19:46 2022] GET /identity/v3/projects/29a02beb75e24b5ebbb64e25721c9c99 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:19:48.570225 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5350a-0750-4ece-a1d3-39f0fbe753ca None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:48.570785 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5350a-0750-4ece-a1d3-39f0fbe753ca None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:48.570785 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5350a-0750-4ece-a1d3-39f0fbe753ca None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:48.575700 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:19:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:19:48.586135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8abbc-6de8-4c83-84b9-d12df5ca514f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:48.586984 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8abbc-6de8-4c83-84b9-d12df5ca514f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:48.586984 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8abbc-6de8-4c83-84b9-d12df5ca514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:48.617086 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-9fa8abbc-6de8-4c83-84b9-d12df5ca514f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:19:48.618898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-9fa8abbc-6de8-4c83-84b9-d12df5ca514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:19:48.630365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:19:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 20:19:48.661697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5350a-0750-4ece-a1d3-39f0fbe753ca None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:48.683020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5350a-0750-4ece-a1d3-39f0fbe753ca None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:48.690025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a683b-5cd0-4398-82ab-476c1d4e3938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:48.690795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a683b-5cd0-4398-82ab-476c1d4e3938 admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:48.691160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a683b-5cd0-4398-82ab-476c1d4e3938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:48.691536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a683b-5cd0-4398-82ab-476c1d4e3938 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:48.701311 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a683b-5cd0-4398-82ab-476c1d4e3938 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:48.704320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a683b-5cd0-4398-82ab-476c1d4e3938 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:48.718828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Jul 25 20:19:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 20:19:48.725650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8abbc-6de8-4c83-84b9-d12df5ca514f None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:48.740910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8abbc-6de8-4c83-84b9-d12df5ca514f None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:48.748551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1364239-6b1a-46e9-ab68-94a697f12951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:48.750601 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364239-6b1a-46e9-ab68-94a697f12951 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:48.751061 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364239-6b1a-46e9-ab68-94a697f12951 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:48.751521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364239-6b1a-46e9-ab68-94a697f12951 admin admin] PATH_INFO: `/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:48.754143 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1364239-6b1a-46e9-ab68-94a697f12951 admin admin] RBAC: Authorizing `identity:get_user(user_id=f0f7e9bbd4e142a7ad92a8b7be39f554)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:48.757542 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1364239-6b1a-46e9-ab68-94a697f12951 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:48.760595 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Mon Jul 25 20:19:48 2022] GET /identity/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:19:52.449829 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d203-b332-4b82-97e5-8823e354a215 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:52.450392 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d203-b332-4b82-97e5-8823e354a215 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:52.450630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17d203-b332-4b82-97e5-8823e354a215 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:52.453005 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:19:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:19:52.460790 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2923b-fa95-4d8d-b4d1-572bdb6a8624 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:52.461673 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2923b-fa95-4d8d-b4d1-572bdb6a8624 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:52.462434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2923b-fa95-4d8d-b4d1-572bdb6a8624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:52.505875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-14d2923b-fa95-4d8d-b4d1-572bdb6a8624 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:19:52.507530 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-14d2923b-fa95-4d8d-b4d1-572bdb6a8624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:19:52.628209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 6/11] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:19:52.654514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d203-b332-4b82-97e5-8823e354a215 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:52.862690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17d203-b332-4b82-97e5-8823e354a215 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:52.933835 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22beac83-10b5-4a2a-9e05-ec7a062bdcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:52.935426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beac83-10b5-4a2a-9e05-ec7a062bdcfe None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:52.935918 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beac83-10b5-4a2a-9e05-ec7a062bdcfe None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:52.936407 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beac83-10b5-4a2a-9e05-ec7a062bdcfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:52.963062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22beac83-10b5-4a2a-9e05-ec7a062bdcfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-22beac83-10b5-4a2a-9e05-ec7a062bdcfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:19:52.980884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:19:52.982870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:19:52.985053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 6/12] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:19:52.994470 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2923b-fa95-4d8d-b4d1-572bdb6a8624 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:53.050862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:53.069189 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e89ab1-c1bf-4cc8-81b7-1ffadee29772 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:53.069683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e89ab1-c1bf-4cc8-81b7-1ffadee29772 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:53.070175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e89ab1-c1bf-4cc8-81b7-1ffadee29772 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:53.073073 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 7/13] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:19:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:19:53.086229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:53.087037 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:53.087532 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:53.121461 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG passlib.handlers.bcrypt [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87207) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 20:19:53.122113 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG passlib.handlers.bcrypt [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87207) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 20:19:53.177295 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:19:53.180279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:19:53.222646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2923b-fa95-4d8d-b4d1-572bdb6a8624 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:53.270870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:53.301363 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:53.302459 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:53.302976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:53.303522 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:53.304859 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:19:53.305431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:53.308474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:53.333825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:19:53.348871 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:53.364561 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:19:53.392494 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:53.535052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:53.569566 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f91da-0d95-4a0c-b92f-93ed72825ce6 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:53.570929 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fafb4-0045-41d6-afe2-e1691df721c9 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:53.635774 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673b30e-9df6-488d-82e7-498d4e6eb4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:53.636747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b30e-9df6-488d-82e7-498d4e6eb4da None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:53.637069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b30e-9df6-488d-82e7-498d4e6eb4da None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:53.637511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b30e-9df6-488d-82e7-498d4e6eb4da None admin] PATH_INFO: `/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:53.639413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673b30e-9df6-488d-82e7-498d4e6eb4da None admin] RBAC: Authorizing `identity:get_user(user_id=f0f7e9bbd4e142a7ad92a8b7be39f554)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:53.641622 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673b30e-9df6-488d-82e7-498d4e6eb4da None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:53.643950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 8/16] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:19:53 2022] GET /identity/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:19:53.649404 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc16b17-4933-4711-ab88-c7fb6594daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:53.650884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc16b17-4933-4711-ab88-c7fb6594daf7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:53.651306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc16b17-4933-4711-ab88-c7fb6594daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:53.651711 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673b30e-9df6-488d-82e7-498d4e6eb4da None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:53.651901 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc16b17-4933-4711-ab88-c7fb6594daf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:53.724947 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:53.809025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc16b17-4933-4711-ab88-c7fb6594daf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:53.811215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc16b17-4933-4711-ab88-c7fb6594daf7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:53.869842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673b30e-9df6-488d-82e7-498d4e6eb4da None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:53.961894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057c4f0-2f70-4b9f-bce5-766578d18245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:53.963075 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c4f0-2f70-4b9f-bce5-766578d18245 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:53.963567 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c4f0-2f70-4b9f-bce5-766578d18245 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:53.964047 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c4f0-2f70-4b9f-bce5-766578d18245 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:53.966349 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057c4f0-2f70-4b9f-bce5-766578d18245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:53.969301 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057c4f0-2f70-4b9f-bce5-766578d18245 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:53.972538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:19:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:19:53.982485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057c4f0-2f70-4b9f-bce5-766578d18245 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:54.029956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:54.032724 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 9/18] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:19:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:54.044975 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc16b17-4933-4711-ab88-c7fb6594daf7 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:54.176085 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:54.216446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057c4f0-2f70-4b9f-bce5-766578d18245 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:54.273006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc16b17-4933-4711-ab88-c7fb6594daf7 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:54.292455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3881307-121a-42d9-8930-86e784680860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:54.293779 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3881307-121a-42d9-8930-86e784680860 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:54.294252 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3881307-121a-42d9-8930-86e784680860 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:54.294824 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3881307-121a-42d9-8930-86e784680860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:54.296202 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3881307-121a-42d9-8930-86e784680860 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.domain.id=default, user.id=f0f7e9bbd4e142a7ad92a8b7be39f554) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:19:54.296694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3881307-121a-42d9-8930-86e784680860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:54.299268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3881307-121a-42d9-8930-86e784680860 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:54.312807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1322 bytes} [Mon Jul 25 20:19:53 2022] GET /identity/v3/role_assignments?user.id=f0f7e9bbd4e142a7ad92a8b7be39f554&scope.domain.id=default&role.id=671de95ce54744059ab540d90d3b40ce => generated 233 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:19:54.361958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7e87-c272-4f5b-b794-38966b62831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:54.364188 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7e87-c272-4f5b-b794-38966b62831d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:54.364763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7e87-c272-4f5b-b794-38966b62831d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:54.365677 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7e87-c272-4f5b-b794-38966b62831d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:54.416532 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7e87-c272-4f5b-b794-38966b62831d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:54.420699 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7e87-c272-4f5b-b794-38966b62831d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-7a6e7e87-c272-4f5b-b794-38966b62831d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:19:54.460086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:19:54.461974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:19:54.463794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:19:54.463794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:19:54.463794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:19:54.463794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:19:54.463794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:19:54.474003 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3881307-121a-42d9-8930-86e784680860 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:54.654215 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:54.681978 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3881307-121a-42d9-8930-86e784680860 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:54.766610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb631441-53ed-4fc7-8f96-c73149751703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:54.767803 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631441-53ed-4fc7-8f96-c73149751703 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:54.768540 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631441-53ed-4fc7-8f96-c73149751703 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:54.769434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631441-53ed-4fc7-8f96-c73149751703 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:54.771884 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb631441-53ed-4fc7-8f96-c73149751703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:19:54.772524 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb631441-53ed-4fc7-8f96-c73149751703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:19:54.775814 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb631441-53ed-4fc7-8f96-c73149751703 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:19:54.823818 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:19:58.909440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565587-6a6c-455e-a95e-0ba246f78689 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:58.910676 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565587-6a6c-455e-a95e-0ba246f78689 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:58.910676 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565587-6a6c-455e-a95e-0ba246f78689 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:58.913933 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:19:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:19:58.924339 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc700f-ee65-4fe3-bcb9-cb6673702ec7 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:58.925351 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc700f-ee65-4fe3-bcb9-cb6673702ec7 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:58.925351 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc700f-ee65-4fe3-bcb9-cb6673702ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:58.966216 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-eacc700f-ee65-4fe3-bcb9-cb6673702ec7 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:19:58.968468 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-eacc700f-ee65-4fe3-bcb9-cb6673702ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:19:59.181635 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 12/23] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:19:59.265613 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6565587-6a6c-455e-a95e-0ba246f78689 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:59.546933 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6565587-6a6c-455e-a95e-0ba246f78689 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:19:59.593256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:59.646484 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ec66-952c-47ba-81f1-842d9d61cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:19:59.647699 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ec66-952c-47ba-81f1-842d9d61cb45 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:19:59.648203 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ec66-952c-47ba-81f1-842d9d61cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:19:59.648747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ec66-952c-47ba-81f1-842d9d61cb45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:19:59.682827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1ec66-952c-47ba-81f1-842d9d61cb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-ddc1ec66-952c-47ba-81f1-842d9d61cb45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:19:59.693021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:19:59.694942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:19:59.696690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 12/24] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:19:59.707284 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc700f-ee65-4fe3-bcb9-cb6673702ec7 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:19:59.928405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:00.026665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc700f-ee65-4fe3-bcb9-cb6673702ec7 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:00.148167 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81c527-7e16-4efa-a4a2-07864b4bb12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:00.149318 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81c527-7e16-4efa-a4a2-07864b4bb12e None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:00.149808 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81c527-7e16-4efa-a4a2-07864b4bb12e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:00.150306 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81c527-7e16-4efa-a4a2-07864b4bb12e None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:00.151766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81c527-7e16-4efa-a4a2-07864b4bb12e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:00.152329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81c527-7e16-4efa-a4a2-07864b4bb12e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:00.155899 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81c527-7e16-4efa-a4a2-07864b4bb12e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:00.183392 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 13/25] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:00.195088 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ec66-952c-47ba-81f1-842d9d61cb45 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:00.253277 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371a02-e1a5-47b1-acbc-3d007b3ee1b1 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:00.254417 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371a02-e1a5-47b1-acbc-3d007b3ee1b1 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:00.255235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac371a02-e1a5-47b1-acbc-3d007b3ee1b1 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:00.258636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 14/26] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:20:00.284062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75c7d2-7050-4144-ad0a-86337777e4d9 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:00.285064 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75c7d2-7050-4144-ad0a-86337777e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:00.285925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75c7d2-7050-4144-ad0a-86337777e4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:00.355229 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-fe75c7d2-7050-4144-ad0a-86337777e4d9 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:00.358285 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-fe75c7d2-7050-4144-ad0a-86337777e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:00.556052 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ec66-952c-47ba-81f1-842d9d61cb45 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:00.691927 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:00.708341 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb7a37-01cb-4518-84ac-0c981cfcd4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:00.709571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb7a37-01cb-4518-84ac-0c981cfcd4b7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:00.710067 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb7a37-01cb-4518-84ac-0c981cfcd4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:00.710568 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb7a37-01cb-4518-84ac-0c981cfcd4b7 None admin] PATH_INFO: `/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:00.713832 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb7a37-01cb-4518-84ac-0c981cfcd4b7 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f7e9bbd4e142a7ad92a8b7be39f554)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:00.716763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb7a37-01cb-4518-84ac-0c981cfcd4b7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:00.728955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 13/28] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:00 2022] GET /identity/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554 => generated 247 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:00.739696 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75c7d2-7050-4144-ad0a-86337777e4d9 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:00.778366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb7a37-01cb-4518-84ac-0c981cfcd4b7 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:00.897368 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:00.954135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:00.987735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75c7d2-7050-4144-ad0a-86337777e4d9 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:01.094207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a650bc3-ab24-4ef1-9079-cde091aab468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:01.098189 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a650bc3-ab24-4ef1-9079-cde091aab468 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:01.099162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a650bc3-ab24-4ef1-9079-cde091aab468 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:01.103162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a650bc3-ab24-4ef1-9079-cde091aab468 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:01.106494 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a650bc3-ab24-4ef1-9079-cde091aab468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:01.112948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a650bc3-ab24-4ef1-9079-cde091aab468 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:01.121410 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 16/29] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:01.127069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9e79-861d-4a9e-9610-e6bf612b4a30 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:01.134942 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9e79-861d-4a9e-9610-e6bf612b4a30 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:01.135901 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9e79-861d-4a9e-9610-e6bf612b4a30 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:01.143103 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 17/30] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:01 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:01.146727 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d9e79-861d-4a9e-9610-e6bf612b4a30 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:01.172891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb7a37-01cb-4518-84ac-0c981cfcd4b7 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:01.309764 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0b705-4c91-44b4-9031-8b3570532907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:01.314546 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0b705-4c91-44b4-9031-8b3570532907 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:01.315494 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0b705-4c91-44b4-9031-8b3570532907 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:01.316228 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0b705-4c91-44b4-9031-8b3570532907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:01.363347 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0b705-4c91-44b4-9031-8b3570532907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:01.366838 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0b705-4c91-44b4-9031-8b3570532907 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-aca0b705-4c91-44b4-9031-8b3570532907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:20:01.426352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:01.427827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:01.429448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:20:01.429448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:20:01.429448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:20:01.429448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:01.435643 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 14/31] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 658 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:01.443263 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac143cdb-65eb-40e4-bff7-4791021ecefe None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:01.444339 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac143cdb-65eb-40e4-bff7-4791021ecefe None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:01.445185 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac143cdb-65eb-40e4-bff7-4791021ecefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:01.508733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ac143cdb-65eb-40e4-bff7-4791021ecefe None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:01.510985 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ac143cdb-65eb-40e4-bff7-4791021ecefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:01.559448 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d9e79-861d-4a9e-9610-e6bf612b4a30 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:01.702618 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 15/32] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:01.704583 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac143cdb-65eb-40e4-bff7-4791021ecefe None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:01.708979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4a2b9-b7ce-4ab3-9287-72716eae6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:01.710741 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a2b9-b7ce-4ab3-9287-72716eae6ae0 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:01.711511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a2b9-b7ce-4ab3-9287-72716eae6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:01.712234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a2b9-b7ce-4ab3-9287-72716eae6ae0 None admin] PATH_INFO: `/v3/domains/default/users/f0f7e9bbd4e142a7ad92a8b7be39f554/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:01.725741 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a2b9-b7ce-4ab3-9287-72716eae6ae0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f0f7e9bbd4e142a7ad92a8b7be39f554, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:01.729130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a2b9-b7ce-4ab3-9287-72716eae6ae0 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:01.734800 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:01.767486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:01.937885 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac143cdb-65eb-40e4-bff7-4791021ecefe None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:02.013002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:02.014745 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.015678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.016520 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.018318 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:02.019210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:02.022217 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:02.059848 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 16/33] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:02.069486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:02.123645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 18/34] 10.222.0.47 () {58 vars in 1361 bytes} [Mon Jul 25 20:20:01 2022] PUT /identity/v3/domains/default/users/f0f7e9bbd4e142a7ad92a8b7be39f554/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 978 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:20:02.135025 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4a2b9-b7ce-4ab3-9287-72716eae6ae0 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:02.261913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:02.297760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df098d72-dc23-47b1-a325-0ed4cc83104c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:02.376186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0927-f174-4b99-8b57-e4a836d9c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:02.377556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0927-f174-4b99-8b57-e4a836d9c286 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.377908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0927-f174-4b99-8b57-e4a836d9c286 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.378418 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0927-f174-4b99-8b57-e4a836d9c286 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.379938 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b0927-f174-4b99-8b57-e4a836d9c286 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:02.383162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b0927-f174-4b99-8b57-e4a836d9c286 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:02.423859 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4a2b9-b7ce-4ab3-9287-72716eae6ae0 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:02.501092 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e322160-7603-4c51-b2f1-b155fdcaa915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:02.501572 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322160-7603-4c51-b2f1-b155fdcaa915 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.501934 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322160-7603-4c51-b2f1-b155fdcaa915 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.502311 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322160-7603-4c51-b2f1-b155fdcaa915 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.503289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e322160-7603-4c51-b2f1-b155fdcaa915 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:02.506091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e322160-7603-4c51-b2f1-b155fdcaa915 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:02.571636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 19/35] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:20:02 2022] POST /identity/v3/projects => generated 301 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:02.574704 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfde76-6b47-4fea-b655-0270c002937d None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.575694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfde76-6b47-4fea-b655-0270c002937d None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.577228 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfde76-6b47-4fea-b655-0270c002937d None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.580358 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 20/36] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:02.583220 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ff375-044a-4b9b-9c2a-192b3471adb8 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.584194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ff375-044a-4b9b-9c2a-192b3471adb8 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.585044 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ff375-044a-4b9b-9c2a-192b3471adb8 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.588537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 21/37] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:02.591569 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224682-3bea-496e-b47b-57fe9f649493 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.593338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224682-3bea-496e-b47b-57fe9f649493 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.594198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224682-3bea-496e-b47b-57fe9f649493 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.597491 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 22/38] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:02.600412 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6e208-fc78-42bb-b04c-b0c7829e607f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.601391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6e208-fc78-42bb-b04c-b0c7829e607f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.602187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6e208-fc78-42bb-b04c-b0c7829e607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.643248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-1ea6e208-fc78-42bb-b04c-b0c7829e607f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:02.647131 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-1ea6e208-fc78-42bb-b04c-b0c7829e607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:02.673759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 17/39] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Jul 25 20:20:02 2022] POST /identity/v3/roles => generated 219 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:02.676629 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266280ef-aab3-4843-baa7-b787f7dddcc5 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.677048 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266280ef-aab3-4843-baa7-b787f7dddcc5 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.681827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266280ef-aab3-4843-baa7-b787f7dddcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.744941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-266280ef-aab3-4843-baa7-b787f7dddcc5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:02.748081 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-266280ef-aab3-4843-baa7-b787f7dddcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:02.796646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:02.885233 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 23/40] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:02.887766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cea3e-f3c2-4419-97e5-006ec4701f04 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:02.888268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cea3e-f3c2-4419-97e5-006ec4701f04 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:02.888773 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cea3e-f3c2-4419-97e5-006ec4701f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:02.924362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-4e8cea3e-f3c2-4419-97e5-006ec4701f04 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:02.926431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-4e8cea3e-f3c2-4419-97e5-006ec4701f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:03.012110 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 18/41] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:03.013783 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266280ef-aab3-4843-baa7-b787f7dddcc5 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:03.102594 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 24/42] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:03.105390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cea3e-f3c2-4419-97e5-006ec4701f04 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:03.217870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:03.279384 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266280ef-aab3-4843-baa7-b787f7dddcc5 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:03.334791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cea3e-f3c2-4419-97e5-006ec4701f04 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:03.347817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:03.373179 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad553ee-e20e-47a2-a727-68b154c9bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:03.375939 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad553ee-e20e-47a2-a727-68b154c9bafd None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:03.376457 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad553ee-e20e-47a2-a727-68b154c9bafd None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:03.377441 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad553ee-e20e-47a2-a727-68b154c9bafd None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:03.378385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad553ee-e20e-47a2-a727-68b154c9bafd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:03.381334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad553ee-e20e-47a2-a727-68b154c9bafd None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:03.411112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 19/43] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Jul 25 20:20:03 2022] POST /identity/v3/roles => generated 225 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:03.411537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74694f08-7358-4c62-a2ed-104b7f4f06cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:03.412634 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad553ee-e20e-47a2-a727-68b154c9bafd None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:03.413068 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694f08-7358-4c62-a2ed-104b7f4f06cf None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:03.413913 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694f08-7358-4c62-a2ed-104b7f4f06cf None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:03.414427 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694f08-7358-4c62-a2ed-104b7f4f06cf None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:03.415871 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74694f08-7358-4c62-a2ed-104b7f4f06cf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:03.418649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74694f08-7358-4c62-a2ed-104b7f4f06cf None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:03.453585 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 25/44] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Jul 25 20:20:03 2022] POST /identity/v3/roles => generated 223 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:03.662116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad553ee-e20e-47a2-a727-68b154c9bafd None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:03.745386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e28282-dae8-4395-87b5-d441910df360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:03.746582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28282-dae8-4395-87b5-d441910df360 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:03.747078 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28282-dae8-4395-87b5-d441910df360 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:03.747575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e28282-dae8-4395-87b5-d441910df360 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:03.750041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e28282-dae8-4395-87b5-d441910df360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:03.752887 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e28282-dae8-4395-87b5-d441910df360 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:03.756040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 20/45] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:03.766592 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74694f08-7358-4c62-a2ed-104b7f4f06cf None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:04.000734 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74694f08-7358-4c62-a2ed-104b7f4f06cf None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:04.078303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a9af8-7846-48a5-bcc7-f47cd236c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:04.079487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9af8-7846-48a5-bcc7-f47cd236c1cd None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:04.079906 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9af8-7846-48a5-bcc7-f47cd236c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:04.080378 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9af8-7846-48a5-bcc7-f47cd236c1cd None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:04.081785 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a9af8-7846-48a5-bcc7-f47cd236c1cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:04.084462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a9af8-7846-48a5-bcc7-f47cd236c1cd None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:04.140660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 26/46] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:20:03 2022] POST /identity/v3/projects => generated 312 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:05.371908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78725b-141b-496a-a748-b26a3c550cfb None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:05.372746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78725b-141b-496a-a748-b26a3c550cfb None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:05.372746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78725b-141b-496a-a748-b26a3c550cfb None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:05.374898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 21/47] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:20:05.384359 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b050-1aa0-48d0-876a-397cf0358d14 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:05.384960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b050-1aa0-48d0-876a-397cf0358d14 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:05.385375 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b050-1aa0-48d0-876a-397cf0358d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:05.420592 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-d9d9b050-1aa0-48d0-876a-397cf0358d14 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:05.422973 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-d9d9b050-1aa0-48d0-876a-397cf0358d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:05.452787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:05.565275 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 27/48] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:05.609040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78725b-141b-496a-a748-b26a3c550cfb None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:05.615858 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:05.853488 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78725b-141b-496a-a748-b26a3c550cfb None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:05.923312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322fa4c-d9b1-4d31-8e27-6ed91b5f14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:05.924596 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322fa4c-d9b1-4d31-8e27-6ed91b5f14ec None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:05.925150 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322fa4c-d9b1-4d31-8e27-6ed91b5f14ec None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:05.925656 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322fa4c-d9b1-4d31-8e27-6ed91b5f14ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:05.947650 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322fa4c-d9b1-4d31-8e27-6ed91b5f14ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-9322fa4c-d9b1-4d31-8e27-6ed91b5f14ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:05.955473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:05.957426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:05.959378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 22/49] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:05.965452 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9b050-1aa0-48d0-876a-397cf0358d14 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:06.182272 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9b050-1aa0-48d0-876a-397cf0358d14 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:06.258298 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:06.259452 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:06.259969 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:06.260479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:06.261983 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:06.262553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:06.266321 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:06.285240 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 28/50] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:06.294950 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322fa4c-d9b1-4d31-8e27-6ed91b5f14ec None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:06.439530 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:06.524305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322fa4c-d9b1-4d31-8e27-6ed91b5f14ec None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:06.600063 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff70fe-702f-4d29-bc89-2ebd4a532491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:06.601273 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff70fe-702f-4d29-bc89-2ebd4a532491 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:06.601800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff70fe-702f-4d29-bc89-2ebd4a532491 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:06.602309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff70fe-702f-4d29-bc89-2ebd4a532491 None admin] PATH_INFO: `/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:06.604863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff70fe-702f-4d29-bc89-2ebd4a532491 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f7e9bbd4e142a7ad92a8b7be39f554)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:06.608348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff70fe-702f-4d29-bc89-2ebd4a532491 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:06.611801 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 23/51] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:06 2022] GET /identity/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554 => generated 247 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:06.621443 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:06.650377 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:06.822668 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf65a3-ad6b-49e4-8e69-1ce0b1783f8b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:06.884223 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7773b-81cd-466f-8cec-bd1565882771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:06.885420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7773b-81cd-466f-8cec-bd1565882771 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:06.885861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7773b-81cd-466f-8cec-bd1565882771 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:06.886199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7773b-81cd-466f-8cec-bd1565882771 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:06.888115 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7773b-81cd-466f-8cec-bd1565882771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:06.890811 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7773b-81cd-466f-8cec-bd1565882771 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:06.893232 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 29/52] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:06.902499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff70fe-702f-4d29-bc89-2ebd4a532491 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:07.118195 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff70fe-702f-4d29-bc89-2ebd4a532491 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:07.184309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:07.195301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a09f1f-34e9-4407-a6cf-40516eb15132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:07.196353 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09f1f-34e9-4407-a6cf-40516eb15132 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:07.196835 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09f1f-34e9-4407-a6cf-40516eb15132 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:07.197386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09f1f-34e9-4407-a6cf-40516eb15132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:07.198891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a09f1f-34e9-4407-a6cf-40516eb15132 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.domain.id=default, user.id=f0f7e9bbd4e142a7ad92a8b7be39f554) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:07.199446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a09f1f-34e9-4407-a6cf-40516eb15132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:07.203070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a09f1f-34e9-4407-a6cf-40516eb15132 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:07.233338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 24/53] 10.222.0.47 () {56 vars in 1322 bytes} [Mon Jul 25 20:20:06 2022] GET /identity/v3/role_assignments?user.id=f0f7e9bbd4e142a7ad92a8b7be39f554&scope.domain.id=default&role.id=671de95ce54744059ab540d90d3b40ce => generated 530 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:07.804059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eb269-bb3b-456f-abf4-ab8b4e63bbce None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:07.804867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eb269-bb3b-456f-abf4-ab8b4e63bbce None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:07.804867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eb269-bb3b-456f-abf4-ab8b4e63bbce None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:07.806665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 30/54] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:20:07.814314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1378-e768-40d2-9c91-cf33de56500e None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:07.815229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1378-e768-40d2-9c91-cf33de56500e None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:07.815404 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1378-e768-40d2-9c91-cf33de56500e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:07.843851 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-a30b1378-e768-40d2-9c91-cf33de56500e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:07.846171 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-a30b1378-e768-40d2-9c91-cf33de56500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:07.994122 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 25/55] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:08.050151 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45eb269-bb3b-456f-abf4-ab8b4e63bbce None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:08.213953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:08.262361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45eb269-bb3b-456f-abf4-ab8b4e63bbce None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:08.335911 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51c486-23a0-40f9-81f3-0e866eb4ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:08.336855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c486-23a0-40f9-81f3-0e866eb4ab59 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:08.337355 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c486-23a0-40f9-81f3-0e866eb4ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:08.337817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c486-23a0-40f9-81f3-0e866eb4ab59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:08.339932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51c486-23a0-40f9-81f3-0e866eb4ab59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:08.343074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51c486-23a0-40f9-81f3-0e866eb4ab59 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:08.346111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 31/56] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:08.353811 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1378-e768-40d2-9c91-cf33de56500e None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:08.508320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1378-e768-40d2-9c91-cf33de56500e None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:08.552104 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:08.574559 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f35c4f-8542-4fb0-a371-f3be2a494178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:08.575613 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35c4f-8542-4fb0-a371-f3be2a494178 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:08.576634 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35c4f-8542-4fb0-a371-f3be2a494178 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:08.578673 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35c4f-8542-4fb0-a371-f3be2a494178 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:08.580462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f35c4f-8542-4fb0-a371-f3be2a494178 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:08.583480 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f35c4f-8542-4fb0-a371-f3be2a494178 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:08.643128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 26/57] 10.222.0.47 () {60 vars in 1140 bytes} [Mon Jul 25 20:20:08 2022] POST /identity/v3/projects => generated 298 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:20:11.356668 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2725513-14fb-489a-b02f-da72dac242f5 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:11.357773 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2725513-14fb-489a-b02f-da72dac242f5 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:11.358352 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2725513-14fb-489a-b02f-da72dac242f5 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:11.360010 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 32/58] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:11.366770 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835be1a-6814-489a-9443-9e06c2b25f5d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:11.367584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835be1a-6814-489a-9443-9e06c2b25f5d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:11.367584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835be1a-6814-489a-9443-9e06c2b25f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:11.402900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-e835be1a-6814-489a-9443-9e06c2b25f5d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:11.405310 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-e835be1a-6814-489a-9443-9e06c2b25f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:11.534913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 27/59] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:11.579261 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2725513-14fb-489a-b02f-da72dac242f5 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:11.794079 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2725513-14fb-489a-b02f-da72dac242f5 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:11.877776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ce418-4844-441a-a759-be8787417ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:11.878563 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce418-4844-441a-a759-be8787417ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:11.878900 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce418-4844-441a-a759-be8787417ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:11.879234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce418-4844-441a-a759-be8787417ba1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:11.880678 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ce418-4844-441a-a759-be8787417ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:11.882307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ce418-4844-441a-a759-be8787417ba1 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:11.884220 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 33/60] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:11.892338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835be1a-6814-489a-9443-9e06c2b25f5d None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:12.084126 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835be1a-6814-489a-9443-9e06c2b25f5d None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:12.098112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:12.140127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dd429-0708-4b0a-b1fb-fcda9f7f7d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:12.141204 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd429-0708-4b0a-b1fb-fcda9f7f7d57 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:12.141606 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd429-0708-4b0a-b1fb-fcda9f7f7d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:12.141884 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd429-0708-4b0a-b1fb-fcda9f7f7d57 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:12.142625 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dd429-0708-4b0a-b1fb-fcda9f7f7d57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:12.144205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dd429-0708-4b0a-b1fb-fcda9f7f7d57 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:12.200620 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 28/61] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:20:11 2022] POST /identity/v3/users => generated 275 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:18.042146 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d5911-80c2-4d21-925a-783e6b8620e9 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.043468 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d5911-80c2-4d21-925a-783e6b8620e9 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.044667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d5911-80c2-4d21-925a-783e6b8620e9 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:18.049770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 34/62] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:18.058400 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1083db-1927-4890-b176-e11ee6d0d56b None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.060557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1083db-1927-4890-b176-e11ee6d0d56b None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.061412 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1083db-1927-4890-b176-e11ee6d0d56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:18.107245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-8f1083db-1927-4890-b176-e11ee6d0d56b None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:18.109149 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-8f1083db-1927-4890-b176-e11ee6d0d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:18.182716 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6abb60-3630-4f25-8b19-636f8effae32 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.183757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6abb60-3630-4f25-8b19-636f8effae32 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.184323 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6abb60-3630-4f25-8b19-636f8effae32 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:18.193298 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 35/63] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:20:18.205910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b1a15-169f-4e09-9952-82d08c8349ab None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.206866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b1a15-169f-4e09-9952-82d08c8349ab None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.207684 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b1a15-169f-4e09-9952-82d08c8349ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:18.276087 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-317b1a15-169f-4e09-9952-82d08c8349ab None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:18.278388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-317b1a15-169f-4e09-9952-82d08c8349ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:18.326379 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:18.338556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 29/64] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:18.391386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1083db-1927-4890-b176-e11ee6d0d56b None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:18.495227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 36/65] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:18.499279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5581-2761-43ae-aa1f-bbbb2b11207f None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.500191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5581-2761-43ae-aa1f-bbbb2b11207f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.500919 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5581-2761-43ae-aa1f-bbbb2b11207f None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:18.505590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 37/66] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:18.516521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514970-14e0-44f0-b589-13d97b2e388b None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.517432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514970-14e0-44f0-b589-13d97b2e388b None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.518178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514970-14e0-44f0-b589-13d97b2e388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:18.558251 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-1e514970-14e0-44f0-b589-13d97b2e388b None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:18.561010 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-1e514970-14e0-44f0-b589-13d97b2e388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:18.683190 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:18.708227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1083db-1927-4890-b176-e11ee6d0d56b None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:18.711425 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 38/67] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:18.715100 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e514970-14e0-44f0-b589-13d97b2e388b None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:18.788257 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d0577-5cc0-4b4b-97bf-c23058cff24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:18.789504 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d0577-5cc0-4b4b-97bf-c23058cff24d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.790039 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d0577-5cc0-4b4b-97bf-c23058cff24d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.790503 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d0577-5cc0-4b4b-97bf-c23058cff24d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:18.815863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d0577-5cc0-4b4b-97bf-c23058cff24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-895d0577-5cc0-4b4b-97bf-c23058cff24d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:18.824009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:18.827771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:18.829028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 30/68] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:18.831867 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844483-2f08-4336-b490-8365f6a87c15 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.831867 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844483-2f08-4336-b490-8365f6a87c15 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.831867 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844483-2f08-4336-b490-8365f6a87c15 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:18.837319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 31/69] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:18.837319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29844483-2f08-4336-b490-8365f6a87c15 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:18.887628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:18.938123 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e514970-14e0-44f0-b589-13d97b2e388b None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:18.997490 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0debfb-db2b-4936-8d6e-6ea1ce89c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:18.998395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0debfb-db2b-4936-8d6e-6ea1ce89c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:18.998681 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0debfb-db2b-4936-8d6e-6ea1ce89c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:18.998916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0debfb-db2b-4936-8d6e-6ea1ce89c6c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.017258 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0debfb-db2b-4936-8d6e-6ea1ce89c6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-8b0debfb-db2b-4936-8d6e-6ea1ce89c6c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:19.030962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:19.032511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 39/70] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:19.034591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0debfb-db2b-4936-8d6e-6ea1ce89c6c3 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:19.066959 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29844483-2f08-4336-b490-8365f6a87c15 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:19.143237 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0857b8e-e235-4f3d-bc86-56a551ca22ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:19.144546 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0857b8e-e235-4f3d-bc86-56a551ca22ae None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:19.144546 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0857b8e-e235-4f3d-bc86-56a551ca22ae None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:19.144546 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0857b8e-e235-4f3d-bc86-56a551ca22ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.161511 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0857b8e-e235-4f3d-bc86-56a551ca22ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-f0857b8e-e235-4f3d-bc86-56a551ca22ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:19.168313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:19.170452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:19.172223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 32/71] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:20:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:19.173778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a0909-0ff4-4f0b-b2ed-bbffaa530fc8 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:19.173778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a0909-0ff4-4f0b-b2ed-bbffaa530fc8 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:19.174231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a0909-0ff4-4f0b-b2ed-bbffaa530fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.197324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-003a0909-0ff4-4f0b-b2ed-bbffaa530fc8 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:19.198537 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-003a0909-0ff4-4f0b-b2ed-bbffaa530fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:19.212778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:19.239517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0debfb-db2b-4936-8d6e-6ea1ce89c6c3 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:19.296764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:19.297641 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:19.298104 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:19.298526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.299370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:19.299817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:19.301644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:19.303798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:19.326877 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 40/72] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:19.326877 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:19.327231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 33/73] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:19.327231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232938f-19bc-4947-8aa8-94567ac2cf66 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:19.327231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232938f-19bc-4947-8aa8-94567ac2cf66 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:19.327231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232938f-19bc-4947-8aa8-94567ac2cf66 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.327231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 34/74] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:19.328531 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232938f-19bc-4947-8aa8-94567ac2cf66 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:19.510411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232938f-19bc-4947-8aa8-94567ac2cf66 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:19.537906 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75132f39-4198-46c3-aef1-377193e6d931 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:19.567428 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:19.568221 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:19.568479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:19.568946 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.569770 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:19.570082 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:19.571533 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:19.587089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 35/75] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:20:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:19.588424 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:19.600200 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197212-2b67-43c6-888f-5a7d0ec0b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:19.601282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197212-2b67-43c6-888f-5a7d0ec0b79e None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:19.601662 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197212-2b67-43c6-888f-5a7d0ec0b79e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:19.602058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197212-2b67-43c6-888f-5a7d0ec0b79e None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.602906 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197212-2b67-43c6-888f-5a7d0ec0b79e None admin] RBAC: Adding query filter params (name=member) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:19.603432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197212-2b67-43c6-888f-5a7d0ec0b79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:19.604291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:19.608570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197212-2b67-43c6-888f-5a7d0ec0b79e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:19.625126 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 41/76] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:19.627581 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8271-ff53-4014-b0eb-95f65df921fa None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:19.628088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8271-ff53-4014-b0eb-95f65df921fa None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:19.628627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe8271-ff53-4014-b0eb-95f65df921fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.657939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-15fe8271-ff53-4014-b0eb-95f65df921fa None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:19.659640 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-15fe8271-ff53-4014-b0eb-95f65df921fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:19.767255 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:19.789264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 42/77] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:19.789914 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8271-ff53-4014-b0eb-95f65df921fa None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:19.804151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deccd1-b595-4a96-a508-e12962eef2a6 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:19.881325 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5bbe-98d7-4a5e-8964-69e4705db2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:19.882510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5bbe-98d7-4a5e-8964-69e4705db2f7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:19.882992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5bbe-98d7-4a5e-8964-69e4705db2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:19.883474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5bbe-98d7-4a5e-8964-69e4705db2f7 None admin] PATH_INFO: `/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:19.885997 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d5bbe-98d7-4a5e-8964-69e4705db2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f7e9bbd4e142a7ad92a8b7be39f554)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:19.889908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d5bbe-98d7-4a5e-8964-69e4705db2f7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:19.893184 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 36/78] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:19 2022] GET /identity/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554 => generated 247 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:19.894735 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5bbe-98d7-4a5e-8964-69e4705db2f7 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:19.984164 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe8271-ff53-4014-b0eb-95f65df921fa None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:20.035005 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d3145-6bd2-4227-a3da-fb96c8c039ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:20.035877 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d3145-6bd2-4227-a3da-fb96c8c039ec None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:20.036377 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d3145-6bd2-4227-a3da-fb96c8c039ec None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:20.036836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d3145-6bd2-4227-a3da-fb96c8c039ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:20.053141 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d3145-6bd2-4227-a3da-fb96c8c039ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:20.056744 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-867d3145-6bd2-4227-a3da-fb96c8c039ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:20.058982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:20.061415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 43/79] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:20.064688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d3145-6bd2-4227-a3da-fb96c8c039ec None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:20.113550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5bbe-98d7-4a5e-8964-69e4705db2f7 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:20.180435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:20.186938 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718100aa-9a9a-4d05-a2f9-dc94dc207b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:20.188178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718100aa-9a9a-4d05-a2f9-dc94dc207b8c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:20.188684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718100aa-9a9a-4d05-a2f9-dc94dc207b8c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:20.189201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718100aa-9a9a-4d05-a2f9-dc94dc207b8c None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:20.217627 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718100aa-9a9a-4d05-a2f9-dc94dc207b8c None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:20.220307 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718100aa-9a9a-4d05-a2f9-dc94dc207b8c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:20.222402 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 37/80] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:19 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:20.223699 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718100aa-9a9a-4d05-a2f9-dc94dc207b8c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:20.286161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d3145-6bd2-4227-a3da-fb96c8c039ec None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:20.355568 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b569-43ab-4390-a49f-7aeddb1162c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:20.356353 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b569-43ab-4390-a49f-7aeddb1162c9 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:20.357373 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b569-43ab-4390-a49f-7aeddb1162c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:20.357830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279b569-43ab-4390-a49f-7aeddb1162c9 None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:20.359561 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279b569-43ab-4390-a49f-7aeddb1162c9 None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:20.361337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279b569-43ab-4390-a49f-7aeddb1162c9 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:20.363728 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 44/81] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:20 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:20.364765 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b569-43ab-4390-a49f-7aeddb1162c9 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:20.435068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718100aa-9a9a-4d05-a2f9-dc94dc207b8c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:20.496666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:20.505370 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d1787-3f8f-4825-82b4-9c97655cb8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:20.506493 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d1787-3f8f-4825-82b4-9c97655cb8f5 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:20.506869 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d1787-3f8f-4825-82b4-9c97655cb8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:20.507393 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d1787-3f8f-4825-82b4-9c97655cb8f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:20.509172 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d1787-3f8f-4825-82b4-9c97655cb8f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:20.511280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d1787-3f8f-4825-82b4-9c97655cb8f5 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:20.514912 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 38/82] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:20.515919 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d1787-3f8f-4825-82b4-9c97655cb8f5 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:20.552134 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279b569-43ab-4390-a49f-7aeddb1162c9 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:20.585218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:20.612793 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9fc6e-0902-4656-beeb-e986ca85406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:20.613897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fc6e-0902-4656-beeb-e986ca85406b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:20.614422 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fc6e-0902-4656-beeb-e986ca85406b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:20.614818 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9fc6e-0902-4656-beeb-e986ca85406b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:20.719826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9fc6e-0902-4656-beeb-e986ca85406b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:20.720557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d1787-3f8f-4825-82b4-9c97655cb8f5 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:20.722320 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9fc6e-0902-4656-beeb-e986ca85406b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:20.786561 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:20.787460 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:20.787761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:20.788199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:20.789363 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:20.789673 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:20.791117 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:20.803666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 39/83] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:20.804251 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:20.916321 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 45/84] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:20.918670 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9fc6e-0902-4656-beeb-e986ca85406b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:20.923760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:20.957526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:21.007164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18677-bf91-49b0-ad8b-a47a0b24f88f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:21.064911 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2ba9-4897-48cd-8b08-3bc252b619f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:21.066064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2ba9-4897-48cd-8b08-3bc252b619f5 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:21.066580 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2ba9-4897-48cd-8b08-3bc252b619f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:21.067098 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2ba9-4897-48cd-8b08-3bc252b619f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:21.111972 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9fc6e-0902-4656-beeb-e986ca85406b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:21.162680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5c75-73bc-42fa-bfe2-ca04566cc9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:21.163407 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5c75-73bc-42fa-bfe2-ca04566cc9de None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:21.163690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5c75-73bc-42fa-bfe2-ca04566cc9de None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:21.163966 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5c75-73bc-42fa-bfe2-ca04566cc9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:21.212877 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2ba9-4897-48cd-8b08-3bc252b619f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:21.216293 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2ba9-4897-48cd-8b08-3bc252b619f5 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:21.284148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5c75-73bc-42fa-bfe2-ca04566cc9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:21.287091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5c75-73bc-42fa-bfe2-ca04566cc9de None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:21.321385 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:21.342850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:21.416214 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 40/85] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:21.417240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2ba9-4897-48cd-8b08-3bc252b619f5 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:21.485602 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 46/86] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:21.487278 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5c75-73bc-42fa-bfe2-ca04566cc9de None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:21.609674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2ba9-4897-48cd-8b08-3bc252b619f5 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:21.660842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4aa03-d872-40ab-a80d-48b4af3f7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:21.661926 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4aa03-d872-40ab-a80d-48b4af3f7b45 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:21.662375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4aa03-d872-40ab-a80d-48b4af3f7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:21.662752 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4aa03-d872-40ab-a80d-48b4af3f7b45 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:21.663923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4aa03-d872-40ab-a80d-48b4af3f7b45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:21.666558 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4aa03-d872-40ab-a80d-48b4af3f7b45 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:21.677395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5c75-73bc-42fa-bfe2-ca04566cc9de None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:21.703147 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:21.703792 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 41/87] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:20:21 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:21.705940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4aa03-d872-40ab-a80d-48b4af3f7b45 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:21.746554 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:21.757428 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63954fb8-3087-4ba9-9773-9a2df65d678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:21.758690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63954fb8-3087-4ba9-9773-9a2df65d678b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:21.759450 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63954fb8-3087-4ba9-9773-9a2df65d678b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:21.760283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63954fb8-3087-4ba9-9773-9a2df65d678b None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:21.764228 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63954fb8-3087-4ba9-9773-9a2df65d678b None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:21.767794 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63954fb8-3087-4ba9-9773-9a2df65d678b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:21.777890 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 47/88] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:21 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:21.777890 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63954fb8-3087-4ba9-9773-9a2df65d678b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:21.949490 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4aa03-d872-40ab-a80d-48b4af3f7b45 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:22.009601 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a16c88-b188-428b-ab5c-753ffde94c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:22.010504 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16c88-b188-428b-ab5c-753ffde94c71 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:22.010846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16c88-b188-428b-ab5c-753ffde94c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:22.011108 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a16c88-b188-428b-ab5c-753ffde94c71 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:22.012533 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a16c88-b188-428b-ab5c-753ffde94c71 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:22.014435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a16c88-b188-428b-ab5c-753ffde94c71 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:22.018217 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 42/89] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:21 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:22.021365 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a16c88-b188-428b-ab5c-753ffde94c71 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:22.046654 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63954fb8-3087-4ba9-9773-9a2df65d678b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:22.129795 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100247d9-9ed0-4f49-a5f8-7ede46b985f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:22.131086 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100247d9-9ed0-4f49-a5f8-7ede46b985f5 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:22.131590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100247d9-9ed0-4f49-a5f8-7ede46b985f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:22.132151 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100247d9-9ed0-4f49-a5f8-7ede46b985f5 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:22.134987 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100247d9-9ed0-4f49-a5f8-7ede46b985f5 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:22.136905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100247d9-9ed0-4f49-a5f8-7ede46b985f5 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:22.139369 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 48/90] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:21 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:22.140132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100247d9-9ed0-4f49-a5f8-7ede46b985f5 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:22.231212 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:22.264511 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a16c88-b188-428b-ab5c-753ffde94c71 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:22.276917 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:22.346662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae562b-1d15-4c38-b565-6c17fc60bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:22.348265 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae562b-1d15-4c38-b565-6c17fc60bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:22.349353 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae562b-1d15-4c38-b565-6c17fc60bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:22.349821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae562b-1d15-4c38-b565-6c17fc60bfa4 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:22.352483 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae562b-1d15-4c38-b565-6c17fc60bfa4 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:22.354622 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae562b-1d15-4c38-b565-6c17fc60bfa4 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:22.358989 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 43/91] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:22 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:22.360990 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae562b-1d15-4c38-b565-6c17fc60bfa4 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:22.385820 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100247d9-9ed0-4f49-a5f8-7ede46b985f5 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:22.468183 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad305394-a983-4fbe-98ea-fb855f5e8ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:22.470813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad305394-a983-4fbe-98ea-fb855f5e8ac4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:22.471756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad305394-a983-4fbe-98ea-fb855f5e8ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:22.472465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad305394-a983-4fbe-98ea-fb855f5e8ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:22.577683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae562b-1d15-4c38-b565-6c17fc60bfa4 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:22.619575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad305394-a983-4fbe-98ea-fb855f5e8ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:22.622852 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad305394-a983-4fbe-98ea-fb855f5e8ac4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:22.650292 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:22.651941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:22.652806 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:22.654224 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:22.656484 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30, user.id=f0f7e9bbd4e142a7ad92a8b7be39f554) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:22.657876 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:22.660914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:22.674161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 44/92] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:22 2022] GET /identity/v3/role_assignments?user.id=f0f7e9bbd4e142a7ad92a8b7be39f554&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=671de95ce54744059ab540d90d3b40ce => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:22.674900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:22.729709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:22.743975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:22.893221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 49/93] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:22.893450 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33dfd2-8201-46c4-b516-199d65a934d8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:22.893886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad305394-a983-4fbe-98ea-fb855f5e8ac4 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:22.951799 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:22.952091 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:22.952434 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:22.952573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:22.953431 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] RBAC: Adding query filter params (role.id=78e9add141834daea284122464f3f3ed, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30, user.id=6a99665654ad4c7ea175df20f2ac945d) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:22.953745 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:22.955369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:22.964470 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 45/94] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:22 2022] GET /identity/v3/role_assignments?user.id=6a99665654ad4c7ea175df20f2ac945d&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=78e9add141834daea284122464f3f3ed => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:22.965562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:23.149228 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:23.172434 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56623c77-2f9c-48a4-8186-559cf8481f2e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:23.232077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad305394-a983-4fbe-98ea-fb855f5e8ac4 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:23.306461 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0421a48-2c0e-4101-bee0-e3263e0550be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:23.309154 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0421a48-2c0e-4101-bee0-e3263e0550be None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:23.309154 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0421a48-2c0e-4101-bee0-e3263e0550be None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:23.309154 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0421a48-2c0e-4101-bee0-e3263e0550be None admin] PATH_INFO: `/v3/projects/17bf102e38a64e339d4f8d6d5984cfd3` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:23.311056 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0421a48-2c0e-4101-bee0-e3263e0550be None admin] RBAC: Authorizing `identity:get_project(project_id=17bf102e38a64e339d4f8d6d5984cfd3)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:23.313988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0421a48-2c0e-4101-bee0-e3263e0550be None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:23.317251 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 46/95] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:22 2022] GET /identity/v3/projects/17bf102e38a64e339d4f8d6d5984cfd3 => generated 312 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:23.330979 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0421a48-2c0e-4101-bee0-e3263e0550be None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:23.361606 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9ed28-ed97-4cdd-b0bc-af6c9df00bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:23.362337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9ed28-ed97-4cdd-b0bc-af6c9df00bbd None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:23.362652 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9ed28-ed97-4cdd-b0bc-af6c9df00bbd None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:23.362973 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9ed28-ed97-4cdd-b0bc-af6c9df00bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:23.364081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9ed28-ed97-4cdd-b0bc-af6c9df00bbd None admin] RBAC: Adding query filter params (role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30, user.id=6a99665654ad4c7ea175df20f2ac945d) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:23.364654 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9ed28-ed97-4cdd-b0bc-af6c9df00bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:23.366628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9ed28-ed97-4cdd-b0bc-af6c9df00bbd None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:23.380783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 50/96] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:22 2022] GET /identity/v3/role_assignments?user.id=6a99665654ad4c7ea175df20f2ac945d&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 259 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:23.527965 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0421a48-2c0e-4101-bee0-e3263e0550be None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:23.593982 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e981-8235-420b-81e1-80fa167ec477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:23.594706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e981-8235-420b-81e1-80fa167ec477 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:23.595020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e981-8235-420b-81e1-80fa167ec477 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:23.595305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e981-8235-420b-81e1-80fa167ec477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:23.596195 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e981-8235-420b-81e1-80fa167ec477 None admin] RBAC: Adding query filter params (role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=17bf102e38a64e339d4f8d6d5984cfd3, user.id=6a99665654ad4c7ea175df20f2ac945d) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:23.596512 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e981-8235-420b-81e1-80fa167ec477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:23.599053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e981-8235-420b-81e1-80fa167ec477 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:23.607664 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 47/97] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:23 2022] GET /identity/v3/role_assignments?user.id=6a99665654ad4c7ea175df20f2ac945d&scope.project.id=17bf102e38a64e339d4f8d6d5984cfd3&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:26.317163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c6d91-9460-4919-b30a-b033a49250e7 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:26.318758 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c6d91-9460-4919-b30a-b033a49250e7 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:26.319499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c6d91-9460-4919-b30a-b033a49250e7 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:26.322529 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 51/98] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:26.331287 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4185a6-219f-421d-b56a-19f919760c0f None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:26.332841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4185a6-219f-421d-b56a-19f919760c0f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:26.333685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4185a6-219f-421d-b56a-19f919760c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:26.364004 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-2d4185a6-219f-421d-b56a-19f919760c0f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:26.365860 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-2d4185a6-219f-421d-b56a-19f919760c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:26.382194 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:26.498209 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 48/99] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:26.538360 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c6d91-9460-4919-b30a-b033a49250e7 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:26.578337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:26.756233 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c6d91-9460-4919-b30a-b033a49250e7 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:26.822604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fa90b-168a-4d4d-864d-2020be700c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:26.824365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa90b-168a-4d4d-864d-2020be700c47 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:26.825220 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa90b-168a-4d4d-864d-2020be700c47 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:26.826039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa90b-168a-4d4d-864d-2020be700c47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:26.849952 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fa90b-168a-4d4d-864d-2020be700c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-4c8fa90b-168a-4d4d-864d-2020be700c47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:26.858632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:26.859910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:20:26.860685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:26.863320 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 52/100] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:26.870926 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4185a6-219f-421d-b56a-19f919760c0f None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:27.087171 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4185a6-219f-421d-b56a-19f919760c0f None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:27.173281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:27.174084 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:27.174590 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:27.175095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:27.176762 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:27.177352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:27.180423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:27.204361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 49/101] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:27.214159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fa90b-168a-4d4d-864d-2020be700c47 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:27.413613 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:27.470966 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fa90b-168a-4d4d-864d-2020be700c47 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:27.566158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6658b7-408f-43da-a120-649a4b8a4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:27.567768 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6658b7-408f-43da-a120-649a4b8a4eba None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:27.568678 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6658b7-408f-43da-a120-649a4b8a4eba None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:27.569265 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6658b7-408f-43da-a120-649a4b8a4eba None admin] PATH_INFO: `/v3/users/1d18d7c3be414e4091011321b2a29534` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:27.601564 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6658b7-408f-43da-a120-649a4b8a4eba None admin] RBAC: Authorizing `identity:get_user(user_id=1d18d7c3be414e4091011321b2a29534)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:27.604619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6658b7-408f-43da-a120-649a4b8a4eba None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:27.607999 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 53/102] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:27 2022] GET /identity/v3/users/1d18d7c3be414e4091011321b2a29534 => generated 289 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:27.617926 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:27.638727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:27.913556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191b04-c481-49fe-8c65-022e0189c04f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:28.015418 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7ed1-4e34-4b14-a32f-ba0c32aeae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:28.017375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7ed1-4e34-4b14-a32f-ba0c32aeae76 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.018305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7ed1-4e34-4b14-a32f-ba0c32aeae76 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.019143 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7ed1-4e34-4b14-a32f-ba0c32aeae76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.086513 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24412-543a-4317-ab8a-583fbd9f1b12 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.086855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24412-543a-4317-ab8a-583fbd9f1b12 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.087597 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24412-543a-4317-ab8a-583fbd9f1b12 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.090916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 54/103] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:28.098493 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba87c-7cfb-4a87-b6ce-e6538b78cb14 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.099136 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba87c-7cfb-4a87-b6ce-e6538b78cb14 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.099627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba87c-7cfb-4a87-b6ce-e6538b78cb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.142955 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-dceba87c-7cfb-4a87-b6ce-e6538b78cb14 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:28.145571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-dceba87c-7cfb-4a87-b6ce-e6538b78cb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:28.248883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7ed1-4e34-4b14-a32f-ba0c32aeae76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:28.255275 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7ed1-4e34-4b14-a32f-ba0c32aeae76 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:28.289228 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:28.361614 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 55/104] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:28.364866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8e62-7d39-4466-ac66-aacdc3044a54 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.365430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8e62-7d39-4466-ac66-aacdc3044a54 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.366104 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8e62-7d39-4466-ac66-aacdc3044a54 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.368957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 56/105] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:28.378285 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef6bee-c0fe-4ae7-b321-898c601dfdfc None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.378792 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef6bee-c0fe-4ae7-b321-898c601dfdfc None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.379336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef6bee-c0fe-4ae7-b321-898c601dfdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.414261 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-ccef6bee-c0fe-4ae7-b321-898c601dfdfc None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:28.416694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ccef6bee-c0fe-4ae7-b321-898c601dfdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:28.580408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 50/106] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 964 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:28.582760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7ed1-4e34-4b14-a32f-ba0c32aeae76 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:28.606248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:28.634100 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 57/107] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:28.637072 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb4d3-42c1-4863-89c2-662404da7912 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.638485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb4d3-42c1-4863-89c2-662404da7912 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.639074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb4d3-42c1-4863-89c2-662404da7912 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.641338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 58/108] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:28.642634 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeb4d3-42c1-4863-89c2-662404da7912 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:28.856599 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7ed1-4e34-4b14-a32f-ba0c32aeae76 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:28.879153 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:28.887227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeb4d3-42c1-4863-89c2-662404da7912 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:28.948020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5666c-ef54-418e-9542-c93adc690f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:28.950300 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5666c-ef54-418e-9542-c93adc690f59 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.950844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5666c-ef54-418e-9542-c93adc690f59 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.951371 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5666c-ef54-418e-9542-c93adc690f59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.961660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768429c-60d8-4fed-a628-382003a181f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:28.963202 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768429c-60d8-4fed-a628-382003a181f1 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.963989 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768429c-60d8-4fed-a628-382003a181f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.964681 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768429c-60d8-4fed-a628-382003a181f1 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.966951 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768429c-60d8-4fed-a628-382003a181f1 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:28.969395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768429c-60d8-4fed-a628-382003a181f1 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:28.972150 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 59/109] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:28 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:28.974803 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be08d4-3705-403e-a2b8-25a4112a23a5 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:28.975437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be08d4-3705-403e-a2b8-25a4112a23a5 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:28.976056 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be08d4-3705-403e-a2b8-25a4112a23a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:28.976600 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5666c-ef54-418e-9542-c93adc690f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-30d5666c-ef54-418e-9542-c93adc690f59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:28.988095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:28.989914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:28.991013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 51/110] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:28.997495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5666c-ef54-418e-9542-c93adc690f59 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:29.022736 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-88be08d4-3705-403e-a2b8-25a4112a23a5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:29.024666 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-88be08d4-3705-403e-a2b8-25a4112a23a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:29.180085 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:29.205809 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 60/111] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:29.207941 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be08d4-3705-403e-a2b8-25a4112a23a5 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:29.266885 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5666c-ef54-418e-9542-c93adc690f59 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:29.345357 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6b91a-f858-4a1e-8638-ad1c860a7740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:29.347130 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6b91a-f858-4a1e-8638-ad1c860a7740 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:29.347130 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6b91a-f858-4a1e-8638-ad1c860a7740 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:29.347440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6b91a-f858-4a1e-8638-ad1c860a7740 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:29.350179 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6b91a-f858-4a1e-8638-ad1c860a7740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:29.353086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6b91a-f858-4a1e-8638-ad1c860a7740 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:29.356835 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 52/112] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:29.360102 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6b91a-f858-4a1e-8638-ad1c860a7740 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:29.426192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be08d4-3705-403e-a2b8-25a4112a23a5 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:29.432708 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:29.486394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:29.487183 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:29.487535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:29.487964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:29.488875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] RBAC: Adding query filter params (role.id=a983b54895844492bf712e432403e82e, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30, user.id=1d18d7c3be414e4091011321b2a29534) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:29.489322 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:29.491181 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:29.500413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 61/113] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:29 2022] GET /identity/v3/role_assignments?user.id=1d18d7c3be414e4091011321b2a29534&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=a983b54895844492bf712e432403e82e => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:29.502234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:29.571563 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6b91a-f858-4a1e-8638-ad1c860a7740 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:29.661781 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f30eea-4e07-4926-848e-282de13534be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:29.662953 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30eea-4e07-4926-848e-282de13534be None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:29.663477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30eea-4e07-4926-848e-282de13534be None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:29.663982 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30eea-4e07-4926-848e-282de13534be None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:29.665427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f30eea-4e07-4926-848e-282de13534be None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:29.666003 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f30eea-4e07-4926-848e-282de13534be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:29.667133 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:29.669566 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f30eea-4e07-4926-848e-282de13534be None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:29.698386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 53/114] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:29.698386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4da65-a310-4ec0-b755-1e6bcbc5a5ad None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:29.698386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4da65-a310-4ec0-b755-1e6bcbc5a5ad None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:29.698386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4da65-a310-4ec0-b755-1e6bcbc5a5ad None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:29.698386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 54/115] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:29.698386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4da65-a310-4ec0-b755-1e6bcbc5a5ad None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:29.783538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63b72c-ff2d-4e6e-a0f8-89bae4a484d6 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:29.857501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a3791-d0e7-41d6-bbd5-aef40c891e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:29.858742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a3791-d0e7-41d6-bbd5-aef40c891e66 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:29.859258 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a3791-d0e7-41d6-bbd5-aef40c891e66 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:29.859740 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a3791-d0e7-41d6-bbd5-aef40c891e66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:29.877773 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:29.881984 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a3791-d0e7-41d6-bbd5-aef40c891e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:29.888473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4da65-a310-4ec0-b755-1e6bcbc5a5ad None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-5b2a3791-d0e7-41d6-bbd5-aef40c891e66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:29.893836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:29.895598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:29.898236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 62/116] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:29.899518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b8b23-bd72-4ab4-b6c1-894d430ca34a None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:29.899518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b8b23-bd72-4ab4-b6c1-894d430ca34a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:29.899518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b8b23-bd72-4ab4-b6c1-894d430ca34a None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:29.905359 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 63/117] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:29.905359 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b8b23-bd72-4ab4-b6c1-894d430ca34a None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:29.956299 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21eb43-673f-46a8-ba18-dc48ce50fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:29.957210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21eb43-673f-46a8-ba18-dc48ce50fee1 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:29.957647 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21eb43-673f-46a8-ba18-dc48ce50fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:29.958068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21eb43-673f-46a8-ba18-dc48ce50fee1 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:29.959147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21eb43-673f-46a8-ba18-dc48ce50fee1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:29.961234 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21eb43-673f-46a8-ba18-dc48ce50fee1 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:30.012818 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 55/118] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:20:29 2022] POST /identity/v3/projects => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:30.015787 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c968d-b5c8-4f85-849f-7da258433ae3 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:30.016596 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c968d-b5c8-4f85-849f-7da258433ae3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:30.017163 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c968d-b5c8-4f85-849f-7da258433ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:30.076521 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-d00c968d-b5c8-4f85-849f-7da258433ae3 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:30.079102 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-d00c968d-b5c8-4f85-849f-7da258433ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:30.171208 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b8b23-bd72-4ab4-b6c1-894d430ca34a None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:30.211398 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:30.227569 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 56/119] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:30.232695 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c968d-b5c8-4f85-849f-7da258433ae3 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:30.275905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162624b-4085-48c2-b032-863ce9e60a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:30.277252 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162624b-4085-48c2-b032-863ce9e60a67 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:30.279653 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162624b-4085-48c2-b032-863ce9e60a67 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:30.280380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162624b-4085-48c2-b032-863ce9e60a67 None admin] PATH_INFO: `/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:30.284059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162624b-4085-48c2-b032-863ce9e60a67 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f7e9bbd4e142a7ad92a8b7be39f554)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:30.286851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162624b-4085-48c2-b032-863ce9e60a67 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:30.292247 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 64/120] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:29 2022] GET /identity/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554 => generated 247 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:30.295711 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48693-116f-488f-af74-f75b5c631bd8 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:30.296502 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48693-116f-488f-af74-f75b5c631bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:30.297741 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48693-116f-488f-af74-f75b5c631bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:30.329202 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-3ed48693-116f-488f-af74-f75b5c631bd8 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:30.331509 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-3ed48693-116f-488f-af74-f75b5c631bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:30.434145 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:30.475113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 65/121] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:30.476261 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c968d-b5c8-4f85-849f-7da258433ae3 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:30.476433 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed48693-116f-488f-af74-f75b5c631bd8 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:30.540794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:30.541907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:30.542494 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:30.542912 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:30.544994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:30.545709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:30.548417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:30.562600 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 57/122] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:30.563815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:30.736994 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed48693-116f-488f-af74-f75b5c631bd8 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:30.767833 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:30.783666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a5cbf-af7d-47fc-a087-3a7b4b172553 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:30.812229 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e3af-abb5-4ef7-a706-a6267a34984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:30.813425 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e3af-abb5-4ef7-a706-a6267a34984e None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:30.813909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e3af-abb5-4ef7-a706-a6267a34984e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:30.814474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e3af-abb5-4ef7-a706-a6267a34984e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:30.838440 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e3af-abb5-4ef7-a706-a6267a34984e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-2e02e3af-abb5-4ef7-a706-a6267a34984e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:30.850257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:30.853327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:30.857142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:30.859390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 66/123] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:20:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:30.859738 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e3af-abb5-4ef7-a706-a6267a34984e None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:30.866245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544b27-5445-490b-9966-0123a5671252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:30.868289 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544b27-5445-490b-9966-0123a5671252 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:30.868606 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544b27-5445-490b-9966-0123a5671252 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:30.868952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81544b27-5445-490b-9966-0123a5671252 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:30.871212 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81544b27-5445-490b-9966-0123a5671252 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:30.874233 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81544b27-5445-490b-9966-0123a5671252 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:30.876799 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 58/124] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:30 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:30.877817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544b27-5445-490b-9966-0123a5671252 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:30.900983 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:31.062541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81544b27-5445-490b-9966-0123a5671252 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:31.089794 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e3af-abb5-4ef7-a706-a6267a34984e None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:31.129033 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49adbf-ef18-4823-ad9d-00312127272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:31.130566 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49adbf-ef18-4823-ad9d-00312127272a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:31.131345 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49adbf-ef18-4823-ad9d-00312127272a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:31.132122 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49adbf-ef18-4823-ad9d-00312127272a None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:31.135541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49adbf-ef18-4823-ad9d-00312127272a None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:31.139471 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49adbf-ef18-4823-ad9d-00312127272a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:31.149674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 59/125] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:30 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:31.151649 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49adbf-ef18-4823-ad9d-00312127272a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:31.171019 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51e89a-a05e-4986-914c-c47eacb7e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:31.172723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51e89a-a05e-4986-914c-c47eacb7e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:31.172723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51e89a-a05e-4986-914c-c47eacb7e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:31.173194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51e89a-a05e-4986-914c-c47eacb7e4b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:31.195612 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51e89a-a05e-4986-914c-c47eacb7e4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-8e51e89a-a05e-4986-914c-c47eacb7e4b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:31.204950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:31.207122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:31.208596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 67/126] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:31.210234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51e89a-a05e-4986-914c-c47eacb7e4b8 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:31.298936 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:31.330340 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:31.380580 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49adbf-ef18-4823-ad9d-00312127272a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:31.443462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:31.445004 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:31.445865 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:31.446338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:31.448280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:31.448996 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:31.451574 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:31.467028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 60/127] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:20:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:31.468883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:31.487645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51e89a-a05e-4986-914c-c47eacb7e4b8 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:31.543627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a558-28f4-4d97-ba25-8fda0cd31d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:31.544590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a558-28f4-4d97-ba25-8fda0cd31d52 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:31.545016 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a558-28f4-4d97-ba25-8fda0cd31d52 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:31.545536 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a558-28f4-4d97-ba25-8fda0cd31d52 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/users/f0f7e9bbd4e142a7ad92a8b7be39f554/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:31.549745 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03a558-28f4-4d97-ba25-8fda0cd31d52 None admin] RBAC: Authorizing `identity:create_grant(project_id=23dcd03cd00246bfab8d7c2a33bf3a30, user_id=f0f7e9bbd4e142a7ad92a8b7be39f554, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:31.550856 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03a558-28f4-4d97-ba25-8fda0cd31d52 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:31.575646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 68/128] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:20:31 2022] PUT /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/users/f0f7e9bbd4e142a7ad92a8b7be39f554/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:20:31.576844 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a558-28f4-4d97-ba25-8fda0cd31d52 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:31.742538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0d13-62d3-4a38-b417-0833b134de32 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:31.789326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:31.809188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a558-28f4-4d97-ba25-8fda0cd31d52 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:31.859599 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d3e9-09a1-4ce9-95af-83cbcb15b29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:31.860713 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d3e9-09a1-4ce9-95af-83cbcb15b29e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:31.861264 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d3e9-09a1-4ce9-95af-83cbcb15b29e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:31.861729 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d3e9-09a1-4ce9-95af-83cbcb15b29e None admin] PATH_INFO: `/v3/projects/17bf102e38a64e339d4f8d6d5984cfd3` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:31.863981 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009d3e9-09a1-4ce9-95af-83cbcb15b29e None admin] RBAC: Authorizing `identity:get_project(project_id=17bf102e38a64e339d4f8d6d5984cfd3)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:31.867001 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009d3e9-09a1-4ce9-95af-83cbcb15b29e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:31.870661 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 61/129] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:31 2022] GET /identity/v3/projects/17bf102e38a64e339d4f8d6d5984cfd3 => generated 312 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:31.873971 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d3e9-09a1-4ce9-95af-83cbcb15b29e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:31.897688 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:31.910937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:31.912039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:31.912473 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:31.913027 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:31.917145 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:31.917145 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:31.917549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:31.958425 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 69/130] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:31.959834 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:32.256049 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d3e9-09a1-4ce9-95af-83cbcb15b29e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:32.331251 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceeb8d-953f-4a55-bd4b-c69243ffd2f9 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:32.408458 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b7483-fa2b-484b-a6ae-54fc57651985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:32.409555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b7483-fa2b-484b-a6ae-54fc57651985 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:32.410009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b7483-fa2b-484b-a6ae-54fc57651985 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:32.410445 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b7483-fa2b-484b-a6ae-54fc57651985 None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:32.419053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b7483-fa2b-484b-a6ae-54fc57651985 None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:32.421716 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b7483-fa2b-484b-a6ae-54fc57651985 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:32.429340 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 62/131] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:31 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 554 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:32.432437 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b7483-fa2b-484b-a6ae-54fc57651985 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:32.442482 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a1ef2-db39-49a9-ba3f-6184af2cc2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:32.444838 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1ef2-db39-49a9-ba3f-6184af2cc2f3 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:32.447943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1ef2-db39-49a9-ba3f-6184af2cc2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:32.455394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a1ef2-db39-49a9-ba3f-6184af2cc2f3 None admin] PATH_INFO: `/v3/projects/17bf102e38a64e339d4f8d6d5984cfd3/users/6a99665654ad4c7ea175df20f2ac945d/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:32.466596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a1ef2-db39-49a9-ba3f-6184af2cc2f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=17bf102e38a64e339d4f8d6d5984cfd3, user_id=6a99665654ad4c7ea175df20f2ac945d, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:32.469988 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a1ef2-db39-49a9-ba3f-6184af2cc2f3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:32.509486 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 70/132] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:20:31 2022] PUT /identity/v3/projects/17bf102e38a64e339d4f8d6d5984cfd3/users/6a99665654ad4c7ea175df20f2ac945d/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:20:32.517256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a1ef2-db39-49a9-ba3f-6184af2cc2f3 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:32.590023 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:32.770274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:32.891824 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b7483-fa2b-484b-a6ae-54fc57651985 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:32.950537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a1ef2-db39-49a9-ba3f-6184af2cc2f3 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:33.011803 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82d11b-9e8a-4e9b-9675-c8d4e12acec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:33.013437 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82d11b-9e8a-4e9b-9675-c8d4e12acec1 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:33.014009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82d11b-9e8a-4e9b-9675-c8d4e12acec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:33.014510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82d11b-9e8a-4e9b-9675-c8d4e12acec1 None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:33.019249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82d11b-9e8a-4e9b-9675-c8d4e12acec1 None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:33.022190 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82d11b-9e8a-4e9b-9675-c8d4e12acec1 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:33.025840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 63/133] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:32 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 594 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:33.036014 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82d11b-9e8a-4e9b-9675-c8d4e12acec1 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:33.063533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92b56-e42f-4da8-8d86-f9e75a139205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:33.064709 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92b56-e42f-4da8-8d86-f9e75a139205 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:33.065264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92b56-e42f-4da8-8d86-f9e75a139205 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:33.065923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92b56-e42f-4da8-8d86-f9e75a139205 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:33.070615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92b56-e42f-4da8-8d86-f9e75a139205 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:33.073965 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92b56-e42f-4da8-8d86-f9e75a139205 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:33.081930 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 71/134] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:32 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:33.089851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92b56-e42f-4da8-8d86-f9e75a139205 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:33.383740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82d11b-9e8a-4e9b-9675-c8d4e12acec1 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:33.407458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:33.456521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92b56-e42f-4da8-8d86-f9e75a139205 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:33.492025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648a2b-ea3d-4ca8-a1e2-ee0c9ecd331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:33.493253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648a2b-ea3d-4ca8-a1e2-ee0c9ecd331f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:33.493775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648a2b-ea3d-4ca8-a1e2-ee0c9ecd331f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:33.494301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0648a2b-ea3d-4ca8-a1e2-ee0c9ecd331f None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:33.497362 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0648a2b-ea3d-4ca8-a1e2-ee0c9ecd331f None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:33.500485 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0648a2b-ea3d-4ca8-a1e2-ee0c9ecd331f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:33.505785 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 64/135] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:33 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:33.517924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648a2b-ea3d-4ca8-a1e2-ee0c9ecd331f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:33.560735 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:33.570282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eb449-3805-4c1b-b8fc-9aaca577a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:33.571060 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eb449-3805-4c1b-b8fc-9aaca577a570 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:33.571422 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eb449-3805-4c1b-b8fc-9aaca577a570 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:33.571895 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eb449-3805-4c1b-b8fc-9aaca577a570 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/users/6a99665654ad4c7ea175df20f2ac945d/roles/78e9add141834daea284122464f3f3ed` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:33.577260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859eb449-3805-4c1b-b8fc-9aaca577a570 None admin] RBAC: Authorizing `identity:create_grant(project_id=23dcd03cd00246bfab8d7c2a33bf3a30, user_id=6a99665654ad4c7ea175df20f2ac945d, role_id=78e9add141834daea284122464f3f3ed)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:33.578941 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859eb449-3805-4c1b-b8fc-9aaca577a570 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:33.616086 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 72/136] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:20:33 2022] PUT /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/users/6a99665654ad4c7ea175df20f2ac945d/roles/78e9add141834daea284122464f3f3ed => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:20:33.677153 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6a57-83fe-452c-bbeb-8724116c515d None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:33.677381 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6a57-83fe-452c-bbeb-8724116c515d None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:33.677707 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6a57-83fe-452c-bbeb-8724116c515d None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:33.679801 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 73/137] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:20:33.686760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c5fbc-cf35-4ee4-ada9-29a96dcecc71 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:33.687188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c5fbc-cf35-4ee4-ada9-29a96dcecc71 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:33.687444 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c5fbc-cf35-4ee4-ada9-29a96dcecc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:33.734336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-df6c5fbc-cf35-4ee4-ada9-29a96dcecc71 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:33.735600 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-df6c5fbc-cf35-4ee4-ada9-29a96dcecc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:33.905705 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0648a2b-ea3d-4ca8-a1e2-ee0c9ecd331f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:33.918957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 74/138] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:33.960642 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c5fbc-cf35-4ee4-ada9-29a96dcecc71 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:34.020299 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b910-1388-4d82-a728-9501345ef20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:34.021525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b910-1388-4d82-a728-9501345ef20e None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:34.022038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b910-1388-4d82-a728-9501345ef20e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:34.022557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b910-1388-4d82-a728-9501345ef20e None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/users/6a99665654ad4c7ea175df20f2ac945d/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:34.026450 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2b910-1388-4d82-a728-9501345ef20e None admin] RBAC: Authorizing `identity:create_grant(project_id=23dcd03cd00246bfab8d7c2a33bf3a30, user_id=6a99665654ad4c7ea175df20f2ac945d, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:34.035731 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2b910-1388-4d82-a728-9501345ef20e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:34.087881 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 65/139] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:20:33 2022] PUT /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/users/6a99665654ad4c7ea175df20f2ac945d/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:20:34.164749 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:34.217194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c5fbc-cf35-4ee4-ada9-29a96dcecc71 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:34.275493 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb2b45-e67d-4fa0-877d-c51acd75285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:34.276187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2b45-e67d-4fa0-877d-c51acd75285b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:34.276479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2b45-e67d-4fa0-877d-c51acd75285b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:34.276763 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2b45-e67d-4fa0-877d-c51acd75285b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:34.295775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb2b45-e67d-4fa0-877d-c51acd75285b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-67cb2b45-e67d-4fa0-877d-c51acd75285b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:34.301160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:34.302088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:34.302861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 75/140] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:20:34.311464 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b910-1388-4d82-a728-9501345ef20e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:34.490725 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:34.529953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e9e9-1b6e-4b1c-bbd2-6a2609dc5ce9 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:34.530463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e9e9-1b6e-4b1c-bbd2-6a2609dc5ce9 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:34.530676 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e9e9-1b6e-4b1c-bbd2-6a2609dc5ce9 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:34.532505 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 76/141] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:20:34.556092 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0169-b176-4d21-a6ef-01bd764c9665 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:34.556729 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0169-b176-4d21-a6ef-01bd764c9665 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:34.557073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a0169-b176-4d21-a6ef-01bd764c9665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:34.577381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b910-1388-4d82-a728-9501345ef20e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:34.604254 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-637a0169-b176-4d21-a6ef-01bd764c9665 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:34.606139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-637a0169-b176-4d21-a6ef-01bd764c9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:34.692887 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:34.694578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:34.695840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:34.698282 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:34.700486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:34.701854 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:34.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:34.738669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 66/142] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:34.758070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:34.800707 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 77/143] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:34.843643 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a0169-b176-4d21-a6ef-01bd764c9665 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:34.998993 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:35.070766 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63764551-6f93-490c-9fe5-271a5160e776 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:35.093035 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a0169-b176-4d21-a6ef-01bd764c9665 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:35.186857 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f09a3-4f4e-48a4-b595-8152b725f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:35.187559 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f09a3-4f4e-48a4-b595-8152b725f398 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:35.187847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f09a3-4f4e-48a4-b595-8152b725f398 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:35.188127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f09a3-4f4e-48a4-b595-8152b725f398 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:35.193139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f09a3-4f4e-48a4-b595-8152b725f398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:35.193139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f09a3-4f4e-48a4-b595-8152b725f398 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:35.193520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 78/144] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:35.200232 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f09a3-4f4e-48a4-b595-8152b725f398 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:35.203200 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:35.220921 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57172377-f091-4ab9-99ae-35315db0dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:35.222856 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172377-f091-4ab9-99ae-35315db0dd0f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:35.223820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172377-f091-4ab9-99ae-35315db0dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:35.224599 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172377-f091-4ab9-99ae-35315db0dd0f None admin] PATH_INFO: `/v3/users/1d18d7c3be414e4091011321b2a29534` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:35.231220 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57172377-f091-4ab9-99ae-35315db0dd0f None admin] RBAC: Authorizing `identity:get_user(user_id=1d18d7c3be414e4091011321b2a29534)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:35.234784 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57172377-f091-4ab9-99ae-35315db0dd0f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:35.238559 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 67/145] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:34 2022] GET /identity/v3/users/1d18d7c3be414e4091011321b2a29534 => generated 289 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:35.246788 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57172377-f091-4ab9-99ae-35315db0dd0f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:35.534703 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f09a3-4f4e-48a4-b595-8152b725f398 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:35.602655 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57172377-f091-4ab9-99ae-35315db0dd0f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:35.634671 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:35.658003 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7055d38-25d6-4d5c-8f18-8e4b02d401d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:35.658901 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055d38-25d6-4d5c-8f18-8e4b02d401d3 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:35.659283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055d38-25d6-4d5c-8f18-8e4b02d401d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:35.659568 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7055d38-25d6-4d5c-8f18-8e4b02d401d3 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:35.660306 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7055d38-25d6-4d5c-8f18-8e4b02d401d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:35.662054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7055d38-25d6-4d5c-8f18-8e4b02d401d3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:35.695514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd44c-15b7-4dd3-8abd-6e3a7e73bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:35.696723 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd44c-15b7-4dd3-8abd-6e3a7e73bd7e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:35.697309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd44c-15b7-4dd3-8abd-6e3a7e73bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:35.697790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd44c-15b7-4dd3-8abd-6e3a7e73bd7e None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:35.706672 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dd44c-15b7-4dd3-8abd-6e3a7e73bd7e None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:35.709640 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dd44c-15b7-4dd3-8abd-6e3a7e73bd7e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:35.713071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 68/146] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:35 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:35.721457 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd44c-15b7-4dd3-8abd-6e3a7e73bd7e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:35.727538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 79/147] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:20:35 2022] POST /identity/v3/users => generated 283 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:35.874455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:35.970450 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd44c-15b7-4dd3-8abd-6e3a7e73bd7e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:36.064571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc29c5-a83d-4d80-87cd-045b346e71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:36.065925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc29c5-a83d-4d80-87cd-045b346e71da None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:36.065925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc29c5-a83d-4d80-87cd-045b346e71da None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:36.065925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc29c5-a83d-4d80-87cd-045b346e71da None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/users/1d18d7c3be414e4091011321b2a29534/roles/a983b54895844492bf712e432403e82e` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:36.070818 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc29c5-a83d-4d80-87cd-045b346e71da None admin] RBAC: Authorizing `identity:create_grant(project_id=23dcd03cd00246bfab8d7c2a33bf3a30, user_id=1d18d7c3be414e4091011321b2a29534, role_id=a983b54895844492bf712e432403e82e)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:36.072425 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc29c5-a83d-4d80-87cd-045b346e71da None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:36.098711 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 69/148] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:20:35 2022] PUT /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/users/1d18d7c3be414e4091011321b2a29534/roles/a983b54895844492bf712e432403e82e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:20:36.386179 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f73438-440e-4eb5-9f9d-70ef9b264def None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:36.387692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f73438-440e-4eb5-9f9d-70ef9b264def None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:36.388629 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f73438-440e-4eb5-9f9d-70ef9b264def None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:36.392005 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 80/149] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:36.398017 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872dc4-3a85-48b8-a55d-31410fa56be6 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:36.398415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872dc4-3a85-48b8-a55d-31410fa56be6 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:36.398562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872dc4-3a85-48b8-a55d-31410fa56be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:36.424133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-87872dc4-3a85-48b8-a55d-31410fa56be6 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:36.425589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-87872dc4-3a85-48b8-a55d-31410fa56be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:36.557667 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 70/150] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:36.590666 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f73438-440e-4eb5-9f9d-70ef9b264def None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:36.887318 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f73438-440e-4eb5-9f9d-70ef9b264def None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:36.968495 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1317d-d45b-42b6-9f79-ae87eff6038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:36.970287 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1317d-d45b-42b6-9f79-ae87eff6038d None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:36.971130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1317d-d45b-42b6-9f79-ae87eff6038d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:36.971949 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1317d-d45b-42b6-9f79-ae87eff6038d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:36.997786 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1317d-d45b-42b6-9f79-ae87eff6038d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-1ea1317d-d45b-42b6-9f79-ae87eff6038d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:37.008799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:37.010574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:37.012142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:37.016117 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 81/151] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:20:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:37.023365 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87872dc4-3a85-48b8-a55d-31410fa56be6 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:37.165955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:37.231453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87872dc4-3a85-48b8-a55d-31410fa56be6 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:37.327476 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:37.328555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:37.329046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:37.329564 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:37.330947 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:37.331499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:37.334281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:37.356961 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 71/152] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:37.365902 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1317d-d45b-42b6-9f79-ae87eff6038d None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:37.499595 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:37.639331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1317d-d45b-42b6-9f79-ae87eff6038d None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:37.734400 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e11e66-b222-43b1-8e3c-67024989e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:37.735653 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e11e66-b222-43b1-8e3c-67024989e076 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:37.736164 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e11e66-b222-43b1-8e3c-67024989e076 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:37.736675 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e11e66-b222-43b1-8e3c-67024989e076 None admin] PATH_INFO: `/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:37.739196 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e11e66-b222-43b1-8e3c-67024989e076 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f7e9bbd4e142a7ad92a8b7be39f554)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:37.742159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e11e66-b222-43b1-8e3c-67024989e076 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:37.746584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 82/153] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:37 2022] GET /identity/v3/users/f0f7e9bbd4e142a7ad92a8b7be39f554 => generated 247 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:37.753280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:38.035107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7d350-d0fb-41c8-98a1-6f7e3d66f13f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:38.081537 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:38.103502 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6602555-3ca2-445d-bc3d-c8c189652413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:38.104140 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602555-3ca2-445d-bc3d-c8c189652413 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:38.104510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602555-3ca2-445d-bc3d-c8c189652413 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:38.104791 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602555-3ca2-445d-bc3d-c8c189652413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:38.248305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6602555-3ca2-445d-bc3d-c8c189652413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:38.251149 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6602555-3ca2-445d-bc3d-c8c189652413 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:38.456766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994afdc-9352-4481-8655-24376a689fef None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:38.457832 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994afdc-9352-4481-8655-24376a689fef None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:38.458332 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994afdc-9352-4481-8655-24376a689fef None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:38.460063 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 83/154] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:38.475281 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59c2d-f886-438a-a363-ece8360ba4ef None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:38.475985 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59c2d-f886-438a-a363-ece8360ba4ef None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:38.476514 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59c2d-f886-438a-a363-ece8360ba4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:38.506948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-d0c59c2d-f886-438a-a363-ece8360ba4ef None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:38.509054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-d0c59c2d-f886-438a-a363-ece8360ba4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:38.556914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 72/155] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:38.565726 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6602555-3ca2-445d-bc3d-c8c189652413 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:38.613756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:38.689232 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 84/156] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:38.798358 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6602555-3ca2-445d-bc3d-c8c189652413 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:38.809598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c59c2d-f886-438a-a363-ece8360ba4ef None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:38.956541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832557b-f75a-4f48-adec-0852943b7022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:38.957420 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832557b-f75a-4f48-adec-0852943b7022 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:38.957909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832557b-f75a-4f48-adec-0852943b7022 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:38.958393 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832557b-f75a-4f48-adec-0852943b7022 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:38.969787 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832557b-f75a-4f48-adec-0852943b7022 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:38.972240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832557b-f75a-4f48-adec-0852943b7022 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:38.975832 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 73/157] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:38 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:38.984466 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832557b-f75a-4f48-adec-0852943b7022 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:39.021682 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:39.211064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:39.228370 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832557b-f75a-4f48-adec-0852943b7022 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:39.244467 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c59c2d-f886-438a-a363-ece8360ba4ef None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:39.271147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46407d58-200c-4c72-b294-482b62f2eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:39.272712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407d58-200c-4c72-b294-482b62f2eb1b None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:39.273253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407d58-200c-4c72-b294-482b62f2eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:39.273752 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407d58-200c-4c72-b294-482b62f2eb1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:39.274772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46407d58-200c-4c72-b294-482b62f2eb1b None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30, user.id=f0f7e9bbd4e142a7ad92a8b7be39f554) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:39.275310 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46407d58-200c-4c72-b294-482b62f2eb1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:39.277862 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46407d58-200c-4c72-b294-482b62f2eb1b None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:39.285682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 74/158] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:38 2022] GET /identity/v3/role_assignments?user.id=f0f7e9bbd4e142a7ad92a8b7be39f554&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=671de95ce54744059ab540d90d3b40ce => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:39.288355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f0b9-8bda-4da8-b0ca-d7b44bbcd297 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:39.289060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f0b9-8bda-4da8-b0ca-d7b44bbcd297 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:39.289582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f0b9-8bda-4da8-b0ca-d7b44bbcd297 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:39.291671 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 75/159] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:39.294163 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9c292-8e4d-4bc5-981f-bc79bc27b43c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:39.294751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9c292-8e4d-4bc5-981f-bc79bc27b43c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:39.295297 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9c292-8e4d-4bc5-981f-bc79bc27b43c None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:39.297132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 76/160] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:39.307355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c70e-54c2-4921-940f-08a009c84eb1 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:39.308008 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c70e-54c2-4921-940f-08a009c84eb1 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:39.309053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c70e-54c2-4921-940f-08a009c84eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:39.330294 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-b9b5c70e-54c2-4921-940f-08a009c84eb1 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:39.332137 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-b9b5c70e-54c2-4921-940f-08a009c84eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:39.375446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6d60-be85-4297-9489-cdb447699080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:39.376609 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6d60-be85-4297-9489-cdb447699080 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:39.377160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6d60-be85-4297-9489-cdb447699080 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:39.377679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6d60-be85-4297-9489-cdb447699080 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:39.407674 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc6d60-be85-4297-9489-cdb447699080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-d9bc6d60-be85-4297-9489-cdb447699080 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:39.427059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:39.428127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:39.429199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:39.429803 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 85/161] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 622 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:39.431526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 77/162] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:39.432704 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbebd85-50c7-4ff1-98f5-26fd65a1aff3 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:39.433234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbebd85-50c7-4ff1-98f5-26fd65a1aff3 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:39.434271 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbebd85-50c7-4ff1-98f5-26fd65a1aff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:39.440663 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5c70e-54c2-4921-940f-08a009c84eb1 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:39.482361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-7bbebd85-50c7-4ff1-98f5-26fd65a1aff3 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:39.484291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-7bbebd85-50c7-4ff1-98f5-26fd65a1aff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:39.563062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:39.589029 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5c70e-54c2-4921-940f-08a009c84eb1 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:39.634474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:39.635571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:39.636050 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:39.637128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:39.638457 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:39.638966 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:39.640591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:39.651965 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 78/163] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:39.653284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:39.751365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 86/164] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:39.752814 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbebd85-50c7-4ff1-98f5-26fd65a1aff3 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:39.783958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda8b2-bbf8-4393-90c3-3bdae3a316b6 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:39.842714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ea18-7b54-455f-9a5c-7d7f998d8f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:39.843673 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:39.845319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ea18-7b54-455f-9a5c-7d7f998d8f2c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:39.845907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ea18-7b54-455f-9a5c-7d7f998d8f2c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:39.846381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ea18-7b54-455f-9a5c-7d7f998d8f2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:39.864800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112ea18-7b54-455f-9a5c-7d7f998d8f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-5112ea18-7b54-455f-9a5c-7d7f998d8f2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:39.871058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:39.871994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:39.872756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:39.875732 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 79/165] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:39.876980 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ea18-7b54-455f-9a5c-7d7f998d8f2c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:39.881452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:39.998823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbebd85-50c7-4ff1-98f5-26fd65a1aff3 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:40.009279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ea18-7b54-455f-9a5c-7d7f998d8f2c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:40.051342 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace148b3-e8aa-447c-a47e-29c295a95eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:40.052390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace148b3-e8aa-447c-a47e-29c295a95eab None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:40.052999 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace148b3-e8aa-447c-a47e-29c295a95eab None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:40.053787 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace148b3-e8aa-447c-a47e-29c295a95eab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:40.071541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace148b3-e8aa-447c-a47e-29c295a95eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:40.074901 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510e661-dc9f-4168-98e9-28f5f9a3b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:40.075595 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e661-dc9f-4168-98e9-28f5f9a3b370 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:40.075909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e661-dc9f-4168-98e9-28f5f9a3b370 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:40.076188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e661-dc9f-4168-98e9-28f5f9a3b370 None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:40.077555 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510e661-dc9f-4168-98e9-28f5f9a3b370 None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-ace148b3-e8aa-447c-a47e-29c295a95eab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:40.079123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:40.080007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:40.080830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:40.081463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510e661-dc9f-4168-98e9-28f5f9a3b370 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:40.081463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 87/166] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:39 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:40.081781 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510e661-dc9f-4168-98e9-28f5f9a3b370 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:40.083187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 80/167] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:20:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:40.105255 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace148b3-e8aa-447c-a47e-29c295a95eab None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:40.192085 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:40.242611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace148b3-e8aa-447c-a47e-29c295a95eab None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:40.286307 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d880c0-ec2e-4cd1-bf5f-f0b1bac1ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:40.287730 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d880c0-ec2e-4cd1-bf5f-f0b1bac1ae37 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:40.288280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d880c0-ec2e-4cd1-bf5f-f0b1bac1ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:40.288694 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d880c0-ec2e-4cd1-bf5f-f0b1bac1ae37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:40.300775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510e661-dc9f-4168-98e9-28f5f9a3b370 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:40.306306 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:40.380009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d880c0-ec2e-4cd1-bf5f-f0b1bac1ae37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:40.381933 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d880c0-ec2e-4cd1-bf5f-f0b1bac1ae37 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:40.385741 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:40.386759 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:40.387236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:40.387722 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:40.388691 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] RBAC: Adding query filter params (name=member) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:40.389470 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:40.391135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:40.408938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 88/168] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:40.410193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:40.461183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:40.515490 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 81/169] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:40.516804 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d880c0-ec2e-4cd1-bf5f-f0b1bac1ae37 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:40.675191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96765bd9-fc72-40cc-be72-cd586222d73c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:40.689640 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d880c0-ec2e-4cd1-bf5f-f0b1bac1ae37 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:40.765088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:40.767284 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:40.767735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:40.769666 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:40.770629 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:40.771976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:40.774064 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:40.779627 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fffc2-bf51-485c-96a4-f1a06562a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:40.780538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fffc2-bf51-485c-96a4-f1a06562a5e3 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:40.782078 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fffc2-bf51-485c-96a4-f1a06562a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:40.782520 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fffc2-bf51-485c-96a4-f1a06562a5e3 None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:40.787225 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fffc2-bf51-485c-96a4-f1a06562a5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:40.788953 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fffc2-bf51-485c-96a4-f1a06562a5e3 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:40.790896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 82/170] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:40 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:40.793741 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fffc2-bf51-485c-96a4-f1a06562a5e3 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:40.796704 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 89/171] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:20:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:40.800824 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:40.862602 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:40.882482 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:40.952051 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fffc2-bf51-485c-96a4-f1a06562a5e3 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:40.992965 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbcac-1003-469b-aad8-84ff76849f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:40.993908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbcac-1003-469b-aad8-84ff76849f86 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:40.994333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbcac-1003-469b-aad8-84ff76849f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:40.994749 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbcac-1003-469b-aad8-84ff76849f86 None admin] PATH_INFO: `/v3/projects/17bf102e38a64e339d4f8d6d5984cfd3` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:40.997167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bbcac-1003-469b-aad8-84ff76849f86 None admin] RBAC: Authorizing `identity:get_project(project_id=17bf102e38a64e339d4f8d6d5984cfd3)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:40.998961 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bbcac-1003-469b-aad8-84ff76849f86 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:41.001130 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 83/172] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:40 2022] GET /identity/v3/projects/17bf102e38a64e339d4f8d6d5984cfd3 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:41.002098 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbcac-1003-469b-aad8-84ff76849f86 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:41.106556 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52571aa2-cebb-4a36-b06e-d7f1d4876a05 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:41.128260 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:41.132689 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbcac-1003-469b-aad8-84ff76849f86 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:41.177603 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394849-b8fe-4543-811c-23924891b17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:41.178779 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394849-b8fe-4543-811c-23924891b17a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:41.179235 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394849-b8fe-4543-811c-23924891b17a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:41.179652 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394849-b8fe-4543-811c-23924891b17a None admin] PATH_INFO: `/v3/users/6a99665654ad4c7ea175df20f2ac945d` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:41.181096 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de394849-b8fe-4543-811c-23924891b17a None admin] RBAC: Authorizing `identity:get_user(user_id=6a99665654ad4c7ea175df20f2ac945d)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:41.182820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de394849-b8fe-4543-811c-23924891b17a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:41.185226 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 84/173] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:41 2022] GET /identity/v3/users/6a99665654ad4c7ea175df20f2ac945d => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:41.186237 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394849-b8fe-4543-811c-23924891b17a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:41.234800 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b315-b183-4c07-b685-6bc5bf3b55e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:41.235845 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b315-b183-4c07-b685-6bc5bf3b55e6 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:41.236363 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b315-b183-4c07-b685-6bc5bf3b55e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:41.236882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b315-b183-4c07-b685-6bc5bf3b55e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:41.316639 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394849-b8fe-4543-811c-23924891b17a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:41.361995 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:41.362888 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:41.363323 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:41.363740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:41.364751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] RBAC: Adding query filter params (role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=17bf102e38a64e339d4f8d6d5984cfd3, user.id=6a99665654ad4c7ea175df20f2ac945d) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:41.365253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:41.366894 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:41.374115 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 85/174] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:41 2022] GET /identity/v3/role_assignments?user.id=6a99665654ad4c7ea175df20f2ac945d&scope.project.id=17bf102e38a64e339d4f8d6d5984cfd3&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:41.375214 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:41.416148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:41.420322 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1b315-b183-4c07-b685-6bc5bf3b55e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:41.422029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1b315-b183-4c07-b685-6bc5bf3b55e6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:41.507437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:41.515099 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607682-a8fd-4ca6-bfb1-a5deb76a827d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:41.564564 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c7c22-3af7-468c-909e-70a9b9f9e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:41.565793 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c7c22-3af7-468c-909e-70a9b9f9e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:41.566258 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c7c22-3af7-468c-909e-70a9b9f9e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:41.566679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c7c22-3af7-468c-909e-70a9b9f9e2f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:41.685213 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c7c22-3af7-468c-909e-70a9b9f9e2f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:41.687206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c7c22-3af7-468c-909e-70a9b9f9e2f1 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:41.724750 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 90/175] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 924 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:41.741136 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b315-b183-4c07-b685-6bc5bf3b55e6 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:41.756986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:41.968772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 86/176] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:41.977968 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c7c22-3af7-468c-909e-70a9b9f9e2f1 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:42.041042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b315-b183-4c07-b685-6bc5bf3b55e6 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:42.139274 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:42.157540 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601abded-a34d-4597-bef2-add5687d7fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:42.159166 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abded-a34d-4597-bef2-add5687d7fbe None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:42.159990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abded-a34d-4597-bef2-add5687d7fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:42.160724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abded-a34d-4597-bef2-add5687d7fbe None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:42.168426 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601abded-a34d-4597-bef2-add5687d7fbe None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:42.171819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601abded-a34d-4597-bef2-add5687d7fbe None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:42.175686 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 91/177] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:41 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:42.186579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601abded-a34d-4597-bef2-add5687d7fbe None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:42.218614 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c7c22-3af7-468c-909e-70a9b9f9e2f1 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:42.286154 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:42.308964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633d96-c635-464c-8e88-195e9966859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:42.310146 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633d96-c635-464c-8e88-195e9966859c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:42.310639 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633d96-c635-464c-8e88-195e9966859c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:42.311117 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633d96-c635-464c-8e88-195e9966859c None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:42.313581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3633d96-c635-464c-8e88-195e9966859c None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:42.316837 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3633d96-c635-464c-8e88-195e9966859c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:42.326092 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 87/178] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:41 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:42.333983 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633d96-c635-464c-8e88-195e9966859c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:42.515287 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601abded-a34d-4597-bef2-add5687d7fbe None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:42.656283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0ccb5-f1ed-466a-9344-9bac151fbeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:42.657457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ccb5-f1ed-466a-9344-9bac151fbeef None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:42.658018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ccb5-f1ed-466a-9344-9bac151fbeef None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:42.658490 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ccb5-f1ed-466a-9344-9bac151fbeef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:42.665162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ccb5-f1ed-466a-9344-9bac151fbeef None admin] RBAC: Adding query filter params (role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30, user.id=6a99665654ad4c7ea175df20f2ac945d) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:42.665162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ccb5-f1ed-466a-9344-9bac151fbeef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:42.665162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ccb5-f1ed-466a-9344-9bac151fbeef None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:42.684469 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 92/179] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:42 2022] GET /identity/v3/role_assignments?user.id=6a99665654ad4c7ea175df20f2ac945d&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 608 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:42.686660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633d96-c635-464c-8e88-195e9966859c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:42.782344 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3c1c-3991-4884-919e-431fd5246735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:42.783337 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3c1c-3991-4884-919e-431fd5246735 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:42.783805 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3c1c-3991-4884-919e-431fd5246735 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:42.784243 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3c1c-3991-4884-919e-431fd5246735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:42.785754 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3c1c-3991-4884-919e-431fd5246735 None admin] RBAC: Adding query filter params (role.id=78e9add141834daea284122464f3f3ed, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30, user.id=6a99665654ad4c7ea175df20f2ac945d) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:42.786297 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3c1c-3991-4884-919e-431fd5246735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:42.789175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3c1c-3991-4884-919e-431fd5246735 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:42.805486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 88/180] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:42 2022] GET /identity/v3/role_assignments?user.id=6a99665654ad4c7ea175df20f2ac945d&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=78e9add141834daea284122464f3f3ed => generated 608 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:43.102133 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5bab9-7d1b-4b07-8d7e-13bb4c0e0fd4 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.102951 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5bab9-7d1b-4b07-8d7e-13bb4c0e0fd4 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.103100 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5bab9-7d1b-4b07-8d7e-13bb4c0e0fd4 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.109136 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 93/181] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:43.124943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec987-b3bf-48c7-ab2c-6fdce7ae6acc None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.125738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec987-b3bf-48c7-ab2c-6fdce7ae6acc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.126417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec987-b3bf-48c7-ab2c-6fdce7ae6acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.168596 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-3b8ec987-b3bf-48c7-ab2c-6fdce7ae6acc None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:43.170893 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-3b8ec987-b3bf-48c7-ab2c-6fdce7ae6acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:43.338139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:43.360303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 89/182] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:43.408224 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5bab9-7d1b-4b07-8d7e-13bb4c0e0fd4 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:43.443364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f8ff-426f-44a6-8256-4f0ee59c44f1 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.443770 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f8ff-426f-44a6-8256-4f0ee59c44f1 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.443921 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f8ff-426f-44a6-8256-4f0ee59c44f1 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.445967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 90/183] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:43.452556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b293-2d32-4a8d-8a33-63ece73f4a20 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.452867 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b293-2d32-4a8d-8a33-63ece73f4a20 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.453303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b293-2d32-4a8d-8a33-63ece73f4a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.478266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ab84b293-2d32-4a8d-8a33-63ece73f4a20 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:43.479667 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ab84b293-2d32-4a8d-8a33-63ece73f4a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:43.552591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:43.618133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 91/184] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:43.619918 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd212-bd46-426d-8cc4-a76fec3565ca None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.621082 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd212-bd46-426d-8cc4-a76fec3565ca None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.621630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd212-bd46-426d-8cc4-a76fec3565ca None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.623401 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 92/185] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:43.629951 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b342-0afe-48f0-a3f8-419554e1faf2 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.630792 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b342-0afe-48f0-a3f8-419554e1faf2 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.631564 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b342-0afe-48f0-a3f8-419554e1faf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.638967 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5bab9-7d1b-4b07-8d7e-13bb4c0e0fd4 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:43.663391 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-85e0b342-0afe-48f0-a3f8-419554e1faf2 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:43.665852 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-85e0b342-0afe-48f0-a3f8-419554e1faf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:43.696008 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441feca-96ea-4f92-90c8-70f963881dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:43.696721 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441feca-96ea-4f92-90c8-70f963881dde None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.696996 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441feca-96ea-4f92-90c8-70f963881dde None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.697291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441feca-96ea-4f92-90c8-70f963881dde None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.711845 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441feca-96ea-4f92-90c8-70f963881dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-c441feca-96ea-4f92-90c8-70f963881dde None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:43.722380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:43.724161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 94/186] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:43.726481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441feca-96ea-4f92-90c8-70f963881dde None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:43.778464 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 93/187] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:43.778464 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0b342-0afe-48f0-a3f8-419554e1faf2 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:43.880381 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441feca-96ea-4f92-90c8-70f963881dde None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:43.890728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:43.910904 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:43.934805 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4fbe-1f76-4c5e-9b14-1458fc211b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:43.935831 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4fbe-1f76-4c5e-9b14-1458fc211b0a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.936283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4fbe-1f76-4c5e-9b14-1458fc211b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.936617 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4fbe-1f76-4c5e-9b14-1458fc211b0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.951058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea4fbe-1f76-4c5e-9b14-1458fc211b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-79ea4fbe-1f76-4c5e-9b14-1458fc211b0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:43.957737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:43.959535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:43.961783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 95/188] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:20:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:43.963335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68aaf6-a8c9-41ce-aa28-ca2234171367 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:43.963335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68aaf6-a8c9-41ce-aa28-ca2234171367 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:43.963335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68aaf6-a8c9-41ce-aa28-ca2234171367 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:43.965450 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 96/189] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:43.966504 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68aaf6-a8c9-41ce-aa28-ca2234171367 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:43.973828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0b342-0afe-48f0-a3f8-419554e1faf2 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:44.026046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:44.027261 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:44.027703 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:44.028205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:44.029624 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:44.030184 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:44.032910 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:44.054901 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 94/190] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:44.056915 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:44.138084 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68aaf6-a8c9-41ce-aa28-ca2234171367 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:44.199737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c25e-509e-42b5-b416-9b008b7a52a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:44.200440 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c25e-509e-42b5-b416-9b008b7a52a2 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:44.200795 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c25e-509e-42b5-b416-9b008b7a52a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:44.201206 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c25e-509e-42b5-b416-9b008b7a52a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:44.216069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c25e-509e-42b5-b416-9b008b7a52a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-a671c25e-509e-42b5-b416-9b008b7a52a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:44.222391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:44.223815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 97/191] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:20:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:44.225394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0026c2-d0a6-4181-8e58-1d19ab0d1344 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:44.226808 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0026c2-d0a6-4181-8e58-1d19ab0d1344 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:44.226808 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0026c2-d0a6-4181-8e58-1d19ab0d1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:44.248689 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbccc63-e636-452d-bfb8-77d06e81a4b2 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:44.262666 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-cd0026c2-d0a6-4181-8e58-1d19ab0d1344 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:44.264812 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-cd0026c2-d0a6-4181-8e58-1d19ab0d1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:44.281846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:44.316923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:44.318049 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:44.318529 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:44.319010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:44.320347 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:44.320868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:44.324089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:44.332917 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:44.340202 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 95/192] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:44.341616 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:44.395475 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 98/193] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:44.396256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0026c2-d0a6-4181-8e58-1d19ab0d1344 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:44.528476 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca71b2c-e02a-4b60-8a56-52de1fb9fe48 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:44.582674 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0026c2-d0a6-4181-8e58-1d19ab0d1344 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:44.582983 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee80b9-0f10-4989-b170-ea836debdb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:44.583667 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee80b9-0f10-4989-b170-ea836debdb53 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:44.583950 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee80b9-0f10-4989-b170-ea836debdb53 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:44.584225 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee80b9-0f10-4989-b170-ea836debdb53 None admin] PATH_INFO: `/v3/users/1d18d7c3be414e4091011321b2a29534` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:44.585769 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee80b9-0f10-4989-b170-ea836debdb53 None admin] RBAC: Authorizing `identity:get_user(user_id=1d18d7c3be414e4091011321b2a29534)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:44.587311 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee80b9-0f10-4989-b170-ea836debdb53 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:44.589149 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 96/194] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:44 2022] GET /identity/v3/users/1d18d7c3be414e4091011321b2a29534 => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:44.590583 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee80b9-0f10-4989-b170-ea836debdb53 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:44.636160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:44.636919 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:44.637243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:44.637531 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:44.638387 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:44.638698 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:44.640297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:44.651532 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 99/195] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:20:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:44.653192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:44.669781 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:44.714838 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:44.779065 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee80b9-0f10-4989-b170-ea836debdb53 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:44.836350 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba6cd2-dafa-4a61-bbf7-2139c96f4043 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:44.840114 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23af5d3-43d2-4faa-a256-e282a14750e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:44.841020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23af5d3-43d2-4faa-a256-e282a14750e4 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:44.841346 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23af5d3-43d2-4faa-a256-e282a14750e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:44.841633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23af5d3-43d2-4faa-a256-e282a14750e4 None admin] PATH_INFO: `/v3/users/2ab4b73b1f8046c4965527063df3f49e` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:44.863475 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23af5d3-43d2-4faa-a256-e282a14750e4 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab4b73b1f8046c4965527063df3f49e)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:44.866302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23af5d3-43d2-4faa-a256-e282a14750e4 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:44.869450 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 97/196] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:44 2022] GET /identity/v3/users/2ab4b73b1f8046c4965527063df3f49e => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:44.870890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23af5d3-43d2-4faa-a256-e282a14750e4 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:44.897949 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9696d-3b49-45b5-bf2f-9d7da63893fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:44.898840 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9696d-3b49-45b5-bf2f-9d7da63893fc None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:44.899342 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9696d-3b49-45b5-bf2f-9d7da63893fc None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:44.899836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9696d-3b49-45b5-bf2f-9d7da63893fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:44.903053 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9696d-3b49-45b5-bf2f-9d7da63893fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:44.905909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9696d-3b49-45b5-bf2f-9d7da63893fc None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:44.913995 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 100/197] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:44.913995 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9696d-3b49-45b5-bf2f-9d7da63893fc None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:45.051008 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23af5d3-43d2-4faa-a256-e282a14750e4 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:45.055924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:45.086621 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:45.092275 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9696d-3b49-45b5-bf2f-9d7da63893fc None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:45.111982 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50adb-ff24-424e-a29f-00533c4f7848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:45.112708 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50adb-ff24-424e-a29f-00533c4f7848 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:45.113086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50adb-ff24-424e-a29f-00533c4f7848 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:45.113420 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50adb-ff24-424e-a29f-00533c4f7848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:45.165379 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc2259-ad7e-418b-8e8f-64e3b835adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:45.166350 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2259-ad7e-418b-8e8f-64e3b835adc7 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:45.166842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2259-ad7e-418b-8e8f-64e3b835adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:45.167909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2259-ad7e-418b-8e8f-64e3b835adc7 None admin] PATH_INFO: `/v3/users/2ab4b73b1f8046c4965527063df3f49e` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:45.170606 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc2259-ad7e-418b-8e8f-64e3b835adc7 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab4b73b1f8046c4965527063df3f49e)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:45.173322 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc2259-ad7e-418b-8e8f-64e3b835adc7 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:45.176544 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 101/198] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:44 2022] GET /identity/v3/users/2ab4b73b1f8046c4965527063df3f49e => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:45.178671 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc2259-ad7e-418b-8e8f-64e3b835adc7 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:45.228630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d50adb-ff24-424e-a29f-00533c4f7848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:45.231541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d50adb-ff24-424e-a29f-00533c4f7848 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:45.325911 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc2259-ad7e-418b-8e8f-64e3b835adc7 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:45.385586 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08893fa3-8650-4057-b07a-f597f52dfaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:45.386504 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893fa3-8650-4057-b07a-f597f52dfaf1 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:45.386894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893fa3-8650-4057-b07a-f597f52dfaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:45.387317 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893fa3-8650-4057-b07a-f597f52dfaf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:45.419891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 98/199] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:45.421296 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50adb-ff24-424e-a29f-00533c4f7848 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:45.428665 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:45.455438 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:45.524263 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08893fa3-8650-4057-b07a-f597f52dfaf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:45.528333 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08893fa3-8650-4057-b07a-f597f52dfaf1 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:45.568152 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50adb-ff24-424e-a29f-00533c4f7848 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:45.642050 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57310f59-5ca5-46db-b4a5-12b4f749758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:45.643130 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310f59-5ca5-46db-b4a5-12b4f749758e None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:45.643648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310f59-5ca5-46db-b4a5-12b4f749758e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:45.644168 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310f59-5ca5-46db-b4a5-12b4f749758e None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:45.645526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57310f59-5ca5-46db-b4a5-12b4f749758e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:45.648427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57310f59-5ca5-46db-b4a5-12b4f749758e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:45.701262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 99/200] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:20:45 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:45.701262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57310f59-5ca5-46db-b4a5-12b4f749758e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:45.716479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 102/201] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:45.718068 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08893fa3-8650-4057-b07a-f597f52dfaf1 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:45.835057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:45.863622 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:45.926681 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08893fa3-8650-4057-b07a-f597f52dfaf1 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:45.927145 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57310f59-5ca5-46db-b4a5-12b4f749758e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:45.983992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b2d1-0a93-45bd-8d1b-866a8a1b2784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:45.984824 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b2d1-0a93-45bd-8d1b-866a8a1b2784 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:45.985281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b2d1-0a93-45bd-8d1b-866a8a1b2784 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:45.985727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b2d1-0a93-45bd-8d1b-866a8a1b2784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:45.998958 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260701a-6a00-4945-9d4f-0a173dc65899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:45.999742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260701a-6a00-4945-9d4f-0a173dc65899 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:46.000033 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260701a-6a00-4945-9d4f-0a173dc65899 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:46.000301 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260701a-6a00-4945-9d4f-0a173dc65899 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:46.001780 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260701a-6a00-4945-9d4f-0a173dc65899 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:46.004365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260701a-6a00-4945-9d4f-0a173dc65899 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:46.007454 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 103/202] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:45 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:46.007454 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260701a-6a00-4945-9d4f-0a173dc65899 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:46.138995 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123b2d1-0a93-45bd-8d1b-866a8a1b2784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:46.141166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123b2d1-0a93-45bd-8d1b-866a8a1b2784 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:46.239459 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260701a-6a00-4945-9d4f-0a173dc65899 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:46.259490 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:46.317281 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ae1d-aab2-4ed4-9af8-d4e5bcbb7f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:46.319032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ae1d-aab2-4ed4-9af8-d4e5bcbb7f3a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:46.319888 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ae1d-aab2-4ed4-9af8-d4e5bcbb7f3a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:46.320699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ae1d-aab2-4ed4-9af8-d4e5bcbb7f3a None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:46.323522 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32ae1d-aab2-4ed4-9af8-d4e5bcbb7f3a None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:46.327395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32ae1d-aab2-4ed4-9af8-d4e5bcbb7f3a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:46.331284 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 104/203] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:46 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:46.341459 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ae1d-aab2-4ed4-9af8-d4e5bcbb7f3a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:46.348616 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:46.523730 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 100/204] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:46.525178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b2d1-0a93-45bd-8d1b-866a8a1b2784 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:46.568665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ae1d-aab2-4ed4-9af8-d4e5bcbb7f3a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:46.636739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:46.637858 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:46.638342 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:46.638960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:46.640533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] RBAC: Adding query filter params (role.id=a983b54895844492bf712e432403e82e, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30, user.id=1d18d7c3be414e4091011321b2a29534) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:46.641076 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:46.644029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:46.657070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 105/205] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:46 2022] GET /identity/v3/role_assignments?user.id=1d18d7c3be414e4091011321b2a29534&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=a983b54895844492bf712e432403e82e => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:46.657794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b2d1-0a93-45bd-8d1b-866a8a1b2784 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:46.658625 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:46.711560 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:46.712207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:46.715949 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:46.715949 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:46.715949 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb, user.id=2ab4b73b1f8046c4965527063df3f49e) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:46.715949 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:46.717628 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:46.735869 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 101/206] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:46 2022] GET /identity/v3/role_assignments?user.id=2ab4b73b1f8046c4965527063df3f49e&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=671de95ce54744059ab540d90d3b40ce => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:46.785701 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:46.847840 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f033a9-5732-4c03-a235-20bb95d80b49 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:46.915899 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a93ec-f115-4ab2-bda2-ac502e57fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:46.916596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a93ec-f115-4ab2-bda2-ac502e57fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:46.916880 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a93ec-f115-4ab2-bda2-ac502e57fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:46.917976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a93ec-f115-4ab2-bda2-ac502e57fdb8 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:46.921252 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a93ec-f115-4ab2-bda2-ac502e57fdb8 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:46.923051 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a93ec-f115-4ab2-bda2-ac502e57fdb8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:46.925419 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 106/207] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:46 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:46.935094 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:46.984409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:47.127560 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd51d32-e1eb-40cf-b7cf-863d62da6c37 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:47.201424 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f6e2-5c0b-4ee3-81cc-1d8587ec1706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:47.202486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f6e2-5c0b-4ee3-81cc-1d8587ec1706 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:47.202976 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f6e2-5c0b-4ee3-81cc-1d8587ec1706 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:47.203461 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f6e2-5c0b-4ee3-81cc-1d8587ec1706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:47.204933 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f6e2-5c0b-4ee3-81cc-1d8587ec1706 None admin] RBAC: Adding query filter params (role.id=78e9add141834daea284122464f3f3ed, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb, user.id=2ab4b73b1f8046c4965527063df3f49e) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:47.205496 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f6e2-5c0b-4ee3-81cc-1d8587ec1706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:47.208108 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f6e2-5c0b-4ee3-81cc-1d8587ec1706 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:47.220339 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 102/208] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:46 2022] GET /identity/v3/role_assignments?user.id=2ab4b73b1f8046c4965527063df3f49e&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=78e9add141834daea284122464f3f3ed => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:48.995021 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5db041-41cc-4287-9740-fa2b69d915be None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:48.995021 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5db041-41cc-4287-9740-fa2b69d915be None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:48.997128 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5db041-41cc-4287-9740-fa2b69d915be None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:48.998008 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 107/209] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:20:49.003981 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d399-6939-4a67-af3d-57571bf4ee32 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:49.004772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d399-6939-4a67-af3d-57571bf4ee32 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:49.004772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d399-6939-4a67-af3d-57571bf4ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:49.027204 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-40e9d399-6939-4a67-af3d-57571bf4ee32 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:49.028630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-40e9d399-6939-4a67-af3d-57571bf4ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:49.173071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 103/210] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:49.201706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5db041-41cc-4287-9740-fa2b69d915be None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:49.336909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5db041-41cc-4287-9740-fa2b69d915be None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:49.379822 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bddfc9-cd1d-403a-b927-2ae1b7f2d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:49.380512 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bddfc9-cd1d-403a-b927-2ae1b7f2d3af None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:49.380798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bddfc9-cd1d-403a-b927-2ae1b7f2d3af None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:49.381074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bddfc9-cd1d-403a-b927-2ae1b7f2d3af None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:49.382482 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bddfc9-cd1d-403a-b927-2ae1b7f2d3af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:49.383990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bddfc9-cd1d-403a-b927-2ae1b7f2d3af None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:49.385837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 108/211] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:49.395069 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d399-6939-4a67-af3d-57571bf4ee32 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:49.418748 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:49.595990 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d399-6939-4a67-af3d-57571bf4ee32 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:49.640038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305a684-3e81-4101-96bb-347501d86f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:49.640685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305a684-3e81-4101-96bb-347501d86f40 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:49.640968 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305a684-3e81-4101-96bb-347501d86f40 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:49.641280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305a684-3e81-4101-96bb-347501d86f40 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:49.642001 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305a684-3e81-4101-96bb-347501d86f40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:49.643481 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305a684-3e81-4101-96bb-347501d86f40 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:49.672079 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 104/212] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:20:49 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:50.156456 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a4323-3a7f-46cf-a463-1bc749e13fa6 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.161819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a4323-3a7f-46cf-a463-1bc749e13fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.161819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a4323-3a7f-46cf-a463-1bc749e13fa6 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.161819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 109/213] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:50.169025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a92e4f-876a-4ac5-80f1-a68f593ed2d2 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.170045 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a92e4f-876a-4ac5-80f1-a68f593ed2d2 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.170524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a92e4f-876a-4ac5-80f1-a68f593ed2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.181615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d2f21-a525-4743-8ce8-378d4fa5e50c None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.181895 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d2f21-a525-4743-8ce8-378d4fa5e50c None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.182418 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d2f21-a525-4743-8ce8-378d4fa5e50c None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.184141 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 110/214] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:20:50.192769 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8484-ed76-41ce-8561-4a182b89c259 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.193605 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8484-ed76-41ce-8561-4a182b89c259 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.194079 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8484-ed76-41ce-8561-4a182b89c259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.196776 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-62a92e4f-876a-4ac5-80f1-a68f593ed2d2 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:50.199723 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-62a92e4f-876a-4ac5-80f1-a68f593ed2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:50.202734 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:50.223771 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-2edd8484-ed76-41ce-8561-4a182b89c259 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:50.230288 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-2edd8484-ed76-41ce-8561-4a182b89c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:50.358793 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 105/215] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:50.369256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 111/216] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:50.388246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a92e4f-876a-4ac5-80f1-a68f593ed2d2 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:50.392302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:50.443840 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8484-ed76-41ce-8561-4a182b89c259 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:50.584711 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a92e4f-876a-4ac5-80f1-a68f593ed2d2 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:50.634249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b735fd-fcd9-4645-859f-9b157df9489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:50.635188 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b735fd-fcd9-4645-859f-9b157df9489b None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.635749 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b735fd-fcd9-4645-859f-9b157df9489b None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.637127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b735fd-fcd9-4645-859f-9b157df9489b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.650211 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8484-ed76-41ce-8561-4a182b89c259 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:50.650530 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b735fd-fcd9-4645-859f-9b157df9489b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-29b735fd-fcd9-4645-859f-9b157df9489b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:50.656668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:50.658514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:50.659820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:50.662434 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 106/217] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:20:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:50.664809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8581b26-6d4d-4b67-aaa4-04ea1f6bfa48 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.665403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8581b26-6d4d-4b67-aaa4-04ea1f6bfa48 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.665885 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8581b26-6d4d-4b67-aaa4-04ea1f6bfa48 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.667840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 107/218] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:50.673622 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8581b26-6d4d-4b67-aaa4-04ea1f6bfa48 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:50.727731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a198f9-3a7d-4f81-82bb-a165ac3a9de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:50.728909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a198f9-3a7d-4f81-82bb-a165ac3a9de9 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.731096 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a198f9-3a7d-4f81-82bb-a165ac3a9de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.731623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a198f9-3a7d-4f81-82bb-a165ac3a9de9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.735535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:50.755470 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:50.759002 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a198f9-3a7d-4f81-82bb-a165ac3a9de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-97a198f9-3a7d-4f81-82bb-a165ac3a9de9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:50.771650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:50.772627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:50.773631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:50.774299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 112/219] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:50.776903 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b048-5069-4030-bc99-2d202075ed9d None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.778881 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b048-5069-4030-bc99-2d202075ed9d None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.779100 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b048-5069-4030-bc99-2d202075ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.809213 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8581b26-6d4d-4b67-aaa4-04ea1f6bfa48 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:50.815494 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-a967b048-5069-4030-bc99-2d202075ed9d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:50.817782 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-a967b048-5069-4030-bc99-2d202075ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:50.855010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:50.856045 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:50.856535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:50.857016 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:50.858007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:50.858525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:50.860314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:50.872137 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 108/220] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:50.873390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:50.975652 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 113/221] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:50.981283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967b048-5069-4030-bc99-2d202075ed9d None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:51.031292 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89b406-2818-4b5c-a0bf-8ea8b7ddd734 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:51.065293 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:51.077359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:51.078429 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:51.078918 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:51.079439 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:51.080514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:51.081038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:51.082906 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:51.094305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 109/222] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:51.095551 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:51.222059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967b048-5069-4030-bc99-2d202075ed9d None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:51.227797 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d2c5c-6b83-4329-8573-8ee619ab06ed None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:51.272348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0ce5-7ad1-49b6-a02b-3898a2c5a58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:51.273392 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0ce5-7ad1-49b6-a02b-3898a2c5a58f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:51.273900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0ce5-7ad1-49b6-a02b-3898a2c5a58f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:51.274374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0ce5-7ad1-49b6-a02b-3898a2c5a58f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:51.278684 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:51.290708 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd0ce5-7ad1-49b6-a02b-3898a2c5a58f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-82dd0ce5-7ad1-49b6-a02b-3898a2c5a58f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:51.299381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:51.300354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:51.301197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:51.303301 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a6273-ddb1-43a0-b1d2-16cf202c5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:51.304270 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 110/223] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:20:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:51.309486 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6273-ddb1-43a0-b1d2-16cf202c5517 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:51.309486 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6273-ddb1-43a0-b1d2-16cf202c5517 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:51.309486 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a6273-ddb1-43a0-b1d2-16cf202c5517 None admin] PATH_INFO: `/v3/users/2ab4b73b1f8046c4965527063df3f49e` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:51.309486 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a6273-ddb1-43a0-b1d2-16cf202c5517 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab4b73b1f8046c4965527063df3f49e)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:51.310978 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0ce5-7ad1-49b6-a02b-3898a2c5a58f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:51.311244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a6273-ddb1-43a0-b1d2-16cf202c5517 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:51.313813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 114/224] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:50 2022] GET /identity/v3/users/2ab4b73b1f8046c4965527063df3f49e => generated 283 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:51.315446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a6273-ddb1-43a0-b1d2-16cf202c5517 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:51.372167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:51.436658 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0ce5-7ad1-49b6-a02b-3898a2c5a58f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:51.482002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a790-e190-4a77-9ac6-1d337466e5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:51.483025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a790-e190-4a77-9ac6-1d337466e5c9 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:51.483515 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a790-e190-4a77-9ac6-1d337466e5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:51.483990 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a790-e190-4a77-9ac6-1d337466e5c9 None admin] PATH_INFO: `/v3/users/eec7d17970174c13898adb69768303bb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:51.501478 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273a790-e190-4a77-9ac6-1d337466e5c9 None admin] RBAC: Authorizing `identity:get_user(user_id=eec7d17970174c13898adb69768303bb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:51.503467 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273a790-e190-4a77-9ac6-1d337466e5c9 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:51.505671 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 111/225] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:51 2022] GET /identity/v3/users/eec7d17970174c13898adb69768303bb => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:51.506807 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a790-e190-4a77-9ac6-1d337466e5c9 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:51.547694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a6273-ddb1-43a0-b1d2-16cf202c5517 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:51.623167 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:51.624308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:51.624956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:51.625615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:51.627125 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:51.627685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:51.629762 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a790-e190-4a77-9ac6-1d337466e5c9 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:51.630380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:51.640123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:51.658957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 115/226] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:20:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:51.658957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:51.690825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56d240-425e-466d-949d-92cc395dc2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:51.692451 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56d240-425e-466d-949d-92cc395dc2b2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:51.693533 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56d240-425e-466d-949d-92cc395dc2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:51.694304 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56d240-425e-466d-949d-92cc395dc2b2 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:51.697205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56d240-425e-466d-949d-92cc395dc2b2 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:51.700967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56d240-425e-466d-949d-92cc395dc2b2 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:51.704256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 112/227] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:51 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:51.705899 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56d240-425e-466d-949d-92cc395dc2b2 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:51.780191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:51.879404 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c51152-75d1-4387-9a56-a27d1177f479 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:51.949581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56d240-425e-466d-949d-92cc395dc2b2 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:51.950238 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f22b3a-cc01-4b18-9993-68a751a23991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:51.950903 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f22b3a-cc01-4b18-9993-68a751a23991 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:51.951182 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f22b3a-cc01-4b18-9993-68a751a23991 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:51.951456 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f22b3a-cc01-4b18-9993-68a751a23991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.018565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175669f-541d-4680-a0d4-ce051becea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:52.019903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175669f-541d-4680-a0d4-ce051becea63 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:52.020545 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175669f-541d-4680-a0d4-ce051becea63 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:52.021230 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175669f-541d-4680-a0d4-ce051becea63 None admin] PATH_INFO: `/v3/users/2ab4b73b1f8046c4965527063df3f49e` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.023224 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175669f-541d-4680-a0d4-ce051becea63 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab4b73b1f8046c4965527063df3f49e)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:52.025829 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175669f-541d-4680-a0d4-ce051becea63 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:52.029490 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 113/228] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:51 2022] GET /identity/v3/users/2ab4b73b1f8046c4965527063df3f49e => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:52.035145 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175669f-541d-4680-a0d4-ce051becea63 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:52.043496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f22b3a-cc01-4b18-9993-68a751a23991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:52.044376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f22b3a-cc01-4b18-9993-68a751a23991 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:52.115611 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:52.140186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:52.184059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 116/229] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:52.184900 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f22b3a-cc01-4b18-9993-68a751a23991 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:52.270280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175669f-541d-4680-a0d4-ce051becea63 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:52.316101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a951df0-f56c-4ae1-803a-802c954aff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:52.317216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a951df0-f56c-4ae1-803a-802c954aff8a None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:52.317703 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a951df0-f56c-4ae1-803a-802c954aff8a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:52.318178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a951df0-f56c-4ae1-803a-802c954aff8a None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/users/2ab4b73b1f8046c4965527063df3f49e/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.320644 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a951df0-f56c-4ae1-803a-802c954aff8a None admin] RBAC: Authorizing `identity:create_grant(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb, user_id=2ab4b73b1f8046c4965527063df3f49e, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:52.322571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a951df0-f56c-4ae1-803a-802c954aff8a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:52.345725 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 114/230] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:20:52 2022] PUT /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/users/2ab4b73b1f8046c4965527063df3f49e/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:20:52.347807 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a951df0-f56c-4ae1-803a-802c954aff8a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:52.560165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f22b3a-cc01-4b18-9993-68a751a23991 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:52.582324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a951df0-f56c-4ae1-803a-802c954aff8a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:52.594351 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:52.634389 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a3b4f-01c0-4fcc-8037-617c04ae4eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:52.637043 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a3b4f-01c0-4fcc-8037-617c04ae4eae None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:52.637925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a3b4f-01c0-4fcc-8037-617c04ae4eae None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:52.638624 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a3b4f-01c0-4fcc-8037-617c04ae4eae None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.641246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a3b4f-01c0-4fcc-8037-617c04ae4eae None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:52.644376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a3b4f-01c0-4fcc-8037-617c04ae4eae None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:52.648284 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 117/231] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:52 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:52.662724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a3b4f-01c0-4fcc-8037-617c04ae4eae None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:52.719821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5aab3-cf8c-4022-907c-4de21eaa35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:52.721706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5aab3-cf8c-4022-907c-4de21eaa35e2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:52.723391 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5aab3-cf8c-4022-907c-4de21eaa35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:52.723391 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5aab3-cf8c-4022-907c-4de21eaa35e2 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.724364 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:52.725750 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5aab3-cf8c-4022-907c-4de21eaa35e2 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:52.727930 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5aab3-cf8c-4022-907c-4de21eaa35e2 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:52.735177 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 115/232] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:52 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:52.741452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655664-860f-43a5-9b17-400caaa614a9 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:52.742036 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655664-860f-43a5-9b17-400caaa614a9 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:52.742462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655664-860f-43a5-9b17-400caaa614a9 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.744141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 116/233] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:52.746393 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655664-860f-43a5-9b17-400caaa614a9 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:52.882968 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a3b4f-01c0-4fcc-8037-617c04ae4eae None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:52.914371 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655664-860f-43a5-9b17-400caaa614a9 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:52.929453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88a904-a533-4dc1-b4bd-363dcb888c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:52.930949 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88a904-a533-4dc1-b4bd-363dcb888c8b None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:52.931247 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88a904-a533-4dc1-b4bd-363dcb888c8b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:52.931653 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88a904-a533-4dc1-b4bd-363dcb888c8b None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/users/2ab4b73b1f8046c4965527063df3f49e/roles/78e9add141834daea284122464f3f3ed` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.935511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88a904-a533-4dc1-b4bd-363dcb888c8b None admin] RBAC: Authorizing `identity:create_grant(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb, user_id=2ab4b73b1f8046c4965527063df3f49e, role_id=78e9add141834daea284122464f3f3ed)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:52.937188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88a904-a533-4dc1-b4bd-363dcb888c8b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:52.956256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 118/234] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:20:52 2022] PUT /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/users/2ab4b73b1f8046c4965527063df3f49e/roles/78e9add141834daea284122464f3f3ed => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:20:52.963802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba099-b096-4353-a3df-ad0094bdfaed None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:52.964798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba099-b096-4353-a3df-ad0094bdfaed None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:52.965703 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba099-b096-4353-a3df-ad0094bdfaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.993154 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63f8b7-dd17-4118-b1a3-ef841d0b06bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:52.994317 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63f8b7-dd17-4118-b1a3-ef841d0b06bf None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:52.995889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63f8b7-dd17-4118-b1a3-ef841d0b06bf None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:52.996447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63f8b7-dd17-4118-b1a3-ef841d0b06bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:52.998746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63f8b7-dd17-4118-b1a3-ef841d0b06bf None admin] RBAC: Adding query filter params (role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb, user.id=eec7d17970174c13898adb69768303bb) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:52.998982 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63f8b7-dd17-4118-b1a3-ef841d0b06bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:53.002054 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63f8b7-dd17-4118-b1a3-ef841d0b06bf None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:53.008813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-119ba099-b096-4353-a3df-ad0094bdfaed None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:53.012058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-119ba099-b096-4353-a3df-ad0094bdfaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:53.015076 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 117/235] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:52 2022] GET /identity/v3/role_assignments?user.id=eec7d17970174c13898adb69768303bb&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:53.017715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4609bd-a535-44b1-be1e-f6eb1164526c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:53.018178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4609bd-a535-44b1-be1e-f6eb1164526c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:53.018661 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4609bd-a535-44b1-be1e-f6eb1164526c None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:53.029184 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 118/236] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:53.033499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e3d6-f3ba-423d-b5e1-ae1ea8bb5b16 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:53.033902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e3d6-f3ba-423d-b5e1-ae1ea8bb5b16 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:53.034082 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e3d6-f3ba-423d-b5e1-ae1ea8bb5b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:53.096271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-5125e3d6-f3ba-423d-b5e1-ae1ea8bb5b16 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:53.103876 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-5125e3d6-f3ba-423d-b5e1-ae1ea8bb5b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:53.209284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:53.241580 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 119/237] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:53.305412 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 119/238] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:53.306210 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba099-b096-4353-a3df-ad0094bdfaed None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:53.330574 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125e3d6-f3ba-423d-b5e1-ae1ea8bb5b16 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:53.341662 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:53.441530 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba099-b096-4353-a3df-ad0094bdfaed None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:53.476799 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125e3d6-f3ba-423d-b5e1-ae1ea8bb5b16 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:53.496872 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168334e-7365-4211-831c-63100d192e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:53.497789 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168334e-7365-4211-831c-63100d192e28 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:53.498071 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168334e-7365-4211-831c-63100d192e28 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:53.498487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168334e-7365-4211-831c-63100d192e28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:53.503193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168334e-7365-4211-831c-63100d192e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:53.505381 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168334e-7365-4211-831c-63100d192e28 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:53.507749 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 120/239] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:53.523958 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168334e-7365-4211-831c-63100d192e28 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:53.525827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e1917-48af-405e-95f0-0c8c5b77ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:53.527383 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e1917-48af-405e-95f0-0c8c5b77ac4c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:53.527679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e1917-48af-405e-95f0-0c8c5b77ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:53.527929 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e1917-48af-405e-95f0-0c8c5b77ac4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:53.542044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e1917-48af-405e-95f0-0c8c5b77ac4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-3a8e1917-48af-405e-95f0-0c8c5b77ac4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:53.547242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:53.548952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:20:53.550526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:53.557516 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 120/240] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:20:53.558546 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e1917-48af-405e-95f0-0c8c5b77ac4c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:53.593160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:53.710740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e1917-48af-405e-95f0-0c8c5b77ac4c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:53.739717 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:53.765309 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168334e-7365-4211-831c-63100d192e28 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:53.806650 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:53.807352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:53.807687 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:53.808093 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:53.808705 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:53.809019 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:53.810508 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:53.811919 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f638-1bac-4cf0-b599-4381d7328abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:53.812838 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f638-1bac-4cf0-b599-4381d7328abb None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:53.813180 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f638-1bac-4cf0-b599-4381d7328abb None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:53.813412 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f638-1bac-4cf0-b599-4381d7328abb None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:53.814132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492f638-1bac-4cf0-b599-4381d7328abb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:53.815647 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492f638-1bac-4cf0-b599-4381d7328abb None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:53.831284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 121/241] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:53.837332 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:53.859232 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 121/242] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:20:53 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:20:54.086506 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:54.131232 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a7d07-3732-4407-8bfc-cc12dce43fc9 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:54.223474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416435a-b35b-43a2-8c8e-67d2a180cf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:54.224854 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416435a-b35b-43a2-8c8e-67d2a180cf2f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:54.225426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416435a-b35b-43a2-8c8e-67d2a180cf2f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:54.225951 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416435a-b35b-43a2-8c8e-67d2a180cf2f None admin] PATH_INFO: `/v3/users/e0ebd86398634d64a69f4da34d6f8e63` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:54.262990 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416435a-b35b-43a2-8c8e-67d2a180cf2f None admin] RBAC: Authorizing `identity:get_user(user_id=e0ebd86398634d64a69f4da34d6f8e63)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:54.266105 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416435a-b35b-43a2-8c8e-67d2a180cf2f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:54.269507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 122/243] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:53 2022] GET /identity/v3/users/e0ebd86398634d64a69f4da34d6f8e63 => generated 297 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:54.280114 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f638-1bac-4cf0-b599-4381d7328abb None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:54.500093 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f638-1bac-4cf0-b599-4381d7328abb None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:54.576467 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfb04-caf5-429e-a888-300953ef6ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:54.577680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfb04-caf5-429e-a888-300953ef6ddf None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:54.578202 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfb04-caf5-429e-a888-300953ef6ddf None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:54.578803 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfb04-caf5-429e-a888-300953ef6ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:54.585936 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:54.728944 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfb04-caf5-429e-a888-300953ef6ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:54.732430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfb04-caf5-429e-a888-300953ef6ddf None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:54.960375 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 122/244] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:54.970646 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416435a-b35b-43a2-8c8e-67d2a180cf2f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:55.203028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416435a-b35b-43a2-8c8e-67d2a180cf2f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:55.296954 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe92e-b9c5-41e5-a90e-3e82188adfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:55.298204 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe92e-b9c5-41e5-a90e-3e82188adfc6 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:55.298728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe92e-b9c5-41e5-a90e-3e82188adfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:55.299235 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe92e-b9c5-41e5-a90e-3e82188adfc6 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:55.301579 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efe92e-b9c5-41e5-a90e-3e82188adfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:55.304789 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efe92e-b9c5-41e5-a90e-3e82188adfc6 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:55.309365 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 123/245] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:54 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:55.320428 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfb04-caf5-429e-a888-300953ef6ddf None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:55.418195 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:55.584176 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfb04-caf5-429e-a888-300953ef6ddf None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:55.660120 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ce9b2-3277-499c-94de-47a120c63b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:55.661249 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ce9b2-3277-499c-94de-47a120c63b28 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:55.661752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ce9b2-3277-499c-94de-47a120c63b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:55.662266 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ce9b2-3277-499c-94de-47a120c63b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:55.663844 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ce9b2-3277-499c-94de-47a120c63b28 None admin] RBAC: Adding query filter params (role.id=a983b54895844492bf712e432403e82e, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb, user.id=e0ebd86398634d64a69f4da34d6f8e63) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:55.664383 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ce9b2-3277-499c-94de-47a120c63b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:55.667942 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ce9b2-3277-499c-94de-47a120c63b28 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:55.679553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 123/246] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:55 2022] GET /identity/v3/role_assignments?user.id=e0ebd86398634d64a69f4da34d6f8e63&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=a983b54895844492bf712e432403e82e => generated 259 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:56.078543 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf7c69-9990-46b0-8836-38607e43b6f3 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:56.079208 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf7c69-9990-46b0-8836-38607e43b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:56.079621 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf7c69-9990-46b0-8836-38607e43b6f3 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:56.082392 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 124/247] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:56.090461 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c6c9-e0bb-4769-abcd-3bea78bc64ef None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:56.091131 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c6c9-e0bb-4769-abcd-3bea78bc64ef None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:56.091382 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c6c9-e0bb-4769-abcd-3bea78bc64ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:56.139284 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-c632c6c9-e0bb-4769-abcd-3bea78bc64ef None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:56.141668 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-c632c6c9-e0bb-4769-abcd-3bea78bc64ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:56.310081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 124/248] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:56.356885 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf7c69-9990-46b0-8836-38607e43b6f3 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:56.395123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:56.651401 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf7c69-9990-46b0-8836-38607e43b6f3 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:56.706912 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10691da-2d42-417b-a3b0-fbfd63066d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:56.707590 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10691da-2d42-417b-a3b0-fbfd63066d9a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:56.707874 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10691da-2d42-417b-a3b0-fbfd63066d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:56.708156 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10691da-2d42-417b-a3b0-fbfd63066d9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:56.730933 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10691da-2d42-417b-a3b0-fbfd63066d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-e10691da-2d42-417b-a3b0-fbfd63066d9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:56.736227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:56.737216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:56.738006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 125/249] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:20:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:56.746329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c6c9-e0bb-4769-abcd-3bea78bc64ef None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:56.792582 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:56.895995 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6c7da-12b6-4d5c-8e2a-f5753e799ead None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:56.896663 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6c7da-12b6-4d5c-8e2a-f5753e799ead None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:56.897161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6c7da-12b6-4d5c-8e2a-f5753e799ead None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:56.899134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 126/250] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:56.919464 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c16a-e027-43dd-9e59-ea4fc74e9aa1 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:56.920112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c16a-e027-43dd-9e59-ea4fc74e9aa1 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:56.920612 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c16a-e027-43dd-9e59-ea4fc74e9aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:56.958642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ba69c16a-e027-43dd-9e59-ea4fc74e9aa1 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:56.959685 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c6c9-e0bb-4769-abcd-3bea78bc64ef None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:56.961898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ba69c16a-e027-43dd-9e59-ea4fc74e9aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:57.047691 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:57.048682 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:57.049090 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:57.049553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:57.050638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:57.051114 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:57.053025 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:57.073202 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 125/251] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:20:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:57.086300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:57.183401 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 127/252] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:57.257346 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69c16a-e027-43dd-9e59-ea4fc74e9aa1 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:57.261757 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:57.340563 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:57.353631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512302ec-f4a1-48af-b68c-3403004b36dc None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:57.425066 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f0a5f-b8ca-4365-9dc9-8bd1fe11115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:57.425849 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0a5f-b8ca-4365-9dc9-8bd1fe11115b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:57.426125 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0a5f-b8ca-4365-9dc9-8bd1fe11115b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:57.426431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0a5f-b8ca-4365-9dc9-8bd1fe11115b None admin] PATH_INFO: `/v3/users/2ab4b73b1f8046c4965527063df3f49e` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:57.428049 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f0a5f-b8ca-4365-9dc9-8bd1fe11115b None admin] RBAC: Authorizing `identity:get_user(user_id=2ab4b73b1f8046c4965527063df3f49e)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:57.429680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f0a5f-b8ca-4365-9dc9-8bd1fe11115b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:57.433650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 126/253] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:57 2022] GET /identity/v3/users/2ab4b73b1f8046c4965527063df3f49e => generated 283 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:57.440579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f0a5f-b8ca-4365-9dc9-8bd1fe11115b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:57.497032 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69c16a-e027-43dd-9e59-ea4fc74e9aa1 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:57.548213 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9150b-901f-4c15-ad69-97cd5d81d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:57.548850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9150b-901f-4c15-ad69-97cd5d81d692 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:57.549162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9150b-901f-4c15-ad69-97cd5d81d692 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:57.549535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9150b-901f-4c15-ad69-97cd5d81d692 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:57.567757 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9150b-901f-4c15-ad69-97cd5d81d692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-30c9150b-901f-4c15-ad69-97cd5d81d692 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:57.574499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:57.576271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:20:57.578704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 128/254] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:57.584066 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9150b-901f-4c15-ad69-97cd5d81d692 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:57.673924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:57.727715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9150b-901f-4c15-ad69-97cd5d81d692 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:57.775519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ceeca-600e-4e9d-9868-dd33446f2000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:57.777470 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ceeca-600e-4e9d-9868-dd33446f2000 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:57.777470 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ceeca-600e-4e9d-9868-dd33446f2000 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:57.777470 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ceeca-600e-4e9d-9868-dd33446f2000 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:57.781161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ceeca-600e-4e9d-9868-dd33446f2000 None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:57.781161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ceeca-600e-4e9d-9868-dd33446f2000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:57.781161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ceeca-600e-4e9d-9868-dd33446f2000 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:57.784599 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f0a5f-b8ca-4365-9dc9-8bd1fe11115b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:57.790951 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 129/255] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:20:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:57.792477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4483e-f713-4af1-b9fe-eb56da2dbd9a None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:57.792792 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4483e-f713-4af1-b9fe-eb56da2dbd9a None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:57.793075 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4483e-f713-4af1-b9fe-eb56da2dbd9a None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:57.794548 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 130/256] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:57.801047 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4483e-f713-4af1-b9fe-eb56da2dbd9a None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:57.882381 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06b572-2b6d-440e-b9c4-a8fc781bce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:57.883434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b572-2b6d-440e-b9c4-a8fc781bce4a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:57.883886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b572-2b6d-440e-b9c4-a8fc781bce4a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:57.884316 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b572-2b6d-440e-b9c4-a8fc781bce4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:57.966117 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4483e-f713-4af1-b9fe-eb56da2dbd9a None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:57.991000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:58.004987 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:58.021421 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d11591-a5c2-4b5e-b58b-fe59038c4aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:58.022593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11591-a5c2-4b5e-b58b-fe59038c4aed None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:58.023092 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11591-a5c2-4b5e-b58b-fe59038c4aed None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:58.023544 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11591-a5c2-4b5e-b58b-fe59038c4aed None admin] PATH_INFO: `/v3/users/eec7d17970174c13898adb69768303bb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:58.030187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d11591-a5c2-4b5e-b58b-fe59038c4aed None admin] RBAC: Authorizing `identity:get_user(user_id=eec7d17970174c13898adb69768303bb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:58.032012 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d11591-a5c2-4b5e-b58b-fe59038c4aed None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:58.038325 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 131/257] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:57 2022] GET /identity/v3/users/eec7d17970174c13898adb69768303bb => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:20:58.039958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74226-ba81-4533-8500-54fc563921c5 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:58.045866 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74226-ba81-4533-8500-54fc563921c5 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:58.046666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef74226-ba81-4533-8500-54fc563921c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:58.078502 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-2ef74226-ba81-4533-8500-54fc563921c5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:58.079772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-2ef74226-ba81-4533-8500-54fc563921c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:58.185932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06b572-2b6d-440e-b9c4-a8fc781bce4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:58.188982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06b572-2b6d-440e-b9c4-a8fc781bce4a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:58.198604 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 132/258] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:58.200077 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef74226-ba81-4533-8500-54fc563921c5 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:58.448921 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef74226-ba81-4533-8500-54fc563921c5 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:58.512046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:58.551469 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 127/259] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:20:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1110 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:58.553418 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06b572-2b6d-440e-b9c4-a8fc781bce4a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:58.562128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f138-ec6f-4ea5-9d4e-362cf629bc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:58.563226 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f138-ec6f-4ea5-9d4e-362cf629bc10 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:58.563687 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f138-ec6f-4ea5-9d4e-362cf629bc10 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:58.564137 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f138-ec6f-4ea5-9d4e-362cf629bc10 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:58.569814 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f138-ec6f-4ea5-9d4e-362cf629bc10 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:58.573145 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f138-ec6f-4ea5-9d4e-362cf629bc10 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:58.578685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 133/260] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:58 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:58.589576 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f138-ec6f-4ea5-9d4e-362cf629bc10 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:58.744971 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:58.875057 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06b572-2b6d-440e-b9c4-a8fc781bce4a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:58.913957 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f138-ec6f-4ea5-9d4e-362cf629bc10 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:58.967357 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2305-cb5b-41a8-bd61-1f09370a5f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:58.969062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2305-cb5b-41a8-bd61-1f09370a5f76 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:58.969932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2305-cb5b-41a8-bd61-1f09370a5f76 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:58.970762 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2305-cb5b-41a8-bd61-1f09370a5f76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:58.993146 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c64ca-245a-41a0-9afe-0f307a800b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:58.993146 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c64ca-245a-41a0-9afe-0f307a800b57 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:58.993146 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c64ca-245a-41a0-9afe-0f307a800b57 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:58.993146 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c64ca-245a-41a0-9afe-0f307a800b57 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:58.993775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c64ca-245a-41a0-9afe-0f307a800b57 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:58.996827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c64ca-245a-41a0-9afe-0f307a800b57 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:59.000289 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 134/261] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:20:58 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:59.001962 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c64ca-245a-41a0-9afe-0f307a800b57 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:59.022424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a2305-cb5b-41a8-bd61-1f09370a5f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-f74a2305-cb5b-41a8-bd61-1f09370a5f76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:20:59.028760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:20:59.030479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 128/262] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:20:59.032953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2305-cb5b-41a8-bd61-1f09370a5f76 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:59.141690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:59.208434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2305-cb5b-41a8-bd61-1f09370a5f76 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:59.249442 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c64ca-245a-41a0-9afe-0f307a800b57 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:59.261863 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:59.314580 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:59.315667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:59.316144 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:59.316618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:59.318096 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] RBAC: Adding query filter params (role.id=78e9add141834daea284122464f3f3ed, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb, user.id=2ab4b73b1f8046c4965527063df3f49e) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:59.318580 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:59.321270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:59.357395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 129/263] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:20:59 2022] GET /identity/v3/role_assignments?user.id=2ab4b73b1f8046c4965527063df3f49e&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=78e9add141834daea284122464f3f3ed => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:59.359149 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:59.362291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af89f-3b79-4224-8f51-c5fc5d14eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:59.363375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af89f-3b79-4224-8f51-c5fc5d14eff5 None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:59.363814 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af89f-3b79-4224-8f51-c5fc5d14eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:59.364244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af89f-3b79-4224-8f51-c5fc5d14eff5 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/users/eec7d17970174c13898adb69768303bb/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:59.370944 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51af89f-3b79-4224-8f51-c5fc5d14eff5 None admin] RBAC: Authorizing `identity:create_grant(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb, user_id=eec7d17970174c13898adb69768303bb, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:59.370944 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51af89f-3b79-4224-8f51-c5fc5d14eff5 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:59.405147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 135/264] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:20:59 2022] PUT /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/users/eec7d17970174c13898adb69768303bb/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:20:59.405147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55058954-d0c5-4f27-82ec-2af0b562a739 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:59.405147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55058954-d0c5-4f27-82ec-2af0b562a739 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:59.405147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55058954-d0c5-4f27-82ec-2af0b562a739 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:59.406224 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 136/265] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:59.408957 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278795a0-7f59-4e2f-bd2d-18ce29f86edc None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:59.409608 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278795a0-7f59-4e2f-bd2d-18ce29f86edc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:59.410105 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278795a0-7f59-4e2f-bd2d-18ce29f86edc None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:59.417214 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 137/266] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:20:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:20:59.417214 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b54c-373b-4f70-b9a1-af099464396e None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:59.435799 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b54c-373b-4f70-b9a1-af099464396e None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:59.435799 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b54c-373b-4f70-b9a1-af099464396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:59.460420 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-3a14b54c-373b-4f70-b9a1-af099464396e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:59.462627 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-3a14b54c-373b-4f70-b9a1-af099464396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:59.610952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 138/267] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:20:59.612540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667028a-4241-4bf3-b45d-a7ec3239dc2b None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:59.612831 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667028a-4241-4bf3-b45d-a7ec3239dc2b None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:59.613128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667028a-4241-4bf3-b45d-a7ec3239dc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:59.634807 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-3667028a-4241-4bf3-b45d-a7ec3239dc2b None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:20:59.636946 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-3667028a-4241-4bf3-b45d-a7ec3239dc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:20:59.697950 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:59.727902 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7619-b27e-4074-b850-2427ae346568 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:59.734147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 139/268] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:59.735356 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667028a-4241-4bf3-b45d-a7ec3239dc2b None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:59.820694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:59.821830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:59.822184 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:59.822630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:59.823717 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:20:59.824183 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:59.827009 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:59.845391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 130/269] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:59.846504 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:20:59.908886 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667028a-4241-4bf3-b45d-a7ec3239dc2b None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:20:59.929142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:59.985507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fada2-1a05-44bc-9bf1-ae96239919af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:20:59.986695 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fada2-1a05-44bc-9bf1-ae96239919af None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:20:59.987198 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fada2-1a05-44bc-9bf1-ae96239919af None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:20:59.987691 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fada2-1a05-44bc-9bf1-ae96239919af None admin] PATH_INFO: `/v3/domains/default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:20:59.989979 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fada2-1a05-44bc-9bf1-ae96239919af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:20:59.992889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fada2-1a05-44bc-9bf1-ae96239919af None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:20:59.996302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 140/270] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:20:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:20:59.997872 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fada2-1a05-44bc-9bf1-ae96239919af None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:00.005469 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119052-0a96-4f0d-bea5-a8c4d8269127 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:00.073495 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad484-d932-428c-9306-54d776d00217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:00.074587 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad484-d932-428c-9306-54d776d00217 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:00.075162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad484-d932-428c-9306-54d776d00217 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:00.075649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad484-d932-428c-9306-54d776d00217 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:00.089450 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ad484-d932-428c-9306-54d776d00217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-b36ad484-d932-428c-9306-54d776d00217 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:00.095620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:00.096632 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:00.097479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:00.100263 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 131/271] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:20:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:00.101436 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad484-d932-428c-9306-54d776d00217 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:00.110468 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:00.204369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fada2-1a05-44bc-9bf1-ae96239919af None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:00.257731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad484-d932-428c-9306-54d776d00217 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:00.266584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5e8b2-3645-4cee-9b0f-78501332c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:00.267771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e8b2-3645-4cee-9b0f-78501332c063 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:00.268322 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e8b2-3645-4cee-9b0f-78501332c063 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:00.268825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e8b2-3645-4cee-9b0f-78501332c063 None admin] PATH_INFO: `/v3/users/2ab4b73b1f8046c4965527063df3f49e` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:00.269383 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:00.271606 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5e8b2-3645-4cee-9b0f-78501332c063 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab4b73b1f8046c4965527063df3f49e)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:00.274795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5e8b2-3645-4cee-9b0f-78501332c063 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:00.278817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 141/272] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:20:59 2022] GET /identity/v3/users/2ab4b73b1f8046c4965527063df3f49e => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:00.280046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5e8b2-3645-4cee-9b0f-78501332c063 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:00.323950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f6515-770f-48b7-a1c2-4217a0ac988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:00.325001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6515-770f-48b7-a1c2-4217a0ac988d None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:00.325567 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6515-770f-48b7-a1c2-4217a0ac988d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:00.326059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6515-770f-48b7-a1c2-4217a0ac988d None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:00.327359 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f6515-770f-48b7-a1c2-4217a0ac988d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:00.330274 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f6515-770f-48b7-a1c2-4217a0ac988d None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:00.363260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 132/273] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:21:00 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:21:00.364674 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef33c-7e29-4a70-ab1f-967543cae253 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:00.364971 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef33c-7e29-4a70-ab1f-967543cae253 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:00.365276 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef33c-7e29-4a70-ab1f-967543cae253 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:00.366679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 133/274] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:00.374316 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ef33c-7e29-4a70-ab1f-967543cae253 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:00.520854 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5e8b2-3645-4cee-9b0f-78501332c063 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:00.554345 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:00.574286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ef33c-7e29-4a70-ab1f-967543cae253 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:00.600800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f332f-4afc-4041-bca7-f9a900415872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:00.601795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f332f-4afc-4041-bca7-f9a900415872 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:00.602316 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f332f-4afc-4041-bca7-f9a900415872 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:00.602830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f332f-4afc-4041-bca7-f9a900415872 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:00.604806 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f332f-4afc-4041-bca7-f9a900415872 None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:00.605417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f332f-4afc-4041-bca7-f9a900415872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:00.608115 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f332f-4afc-4041-bca7-f9a900415872 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:00.626890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 142/275] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:00.629361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980bf8-fe15-4633-afe7-2ce8614563de None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:00.629821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980bf8-fe15-4633-afe7-2ce8614563de None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:00.630286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980bf8-fe15-4633-afe7-2ce8614563de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:00.659534 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39df52c-566a-4f48-b2c1-27d557e7776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:00.661085 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39df52c-566a-4f48-b2c1-27d557e7776b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:00.661937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39df52c-566a-4f48-b2c1-27d557e7776b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:00.662683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-fe980bf8-fe15-4633-afe7-2ce8614563de None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:00.662954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39df52c-566a-4f48-b2c1-27d557e7776b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:00.665250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-fe980bf8-fe15-4633-afe7-2ce8614563de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:00.742201 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:00.801422 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 143/276] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:00.801422 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980bf8-fe15-4633-afe7-2ce8614563de None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:00.850341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39df52c-566a-4f48-b2c1-27d557e7776b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:00.856308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39df52c-566a-4f48-b2c1-27d557e7776b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:01.009609 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980bf8-fe15-4633-afe7-2ce8614563de None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:01.025191 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:01.088961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 134/277] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:01.091013 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39df52c-566a-4f48-b2c1-27d557e7776b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:01.097567 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71633d32-a6be-404b-8e9f-69dee58c354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:01.099223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71633d32-a6be-404b-8e9f-69dee58c354e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:01.100033 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71633d32-a6be-404b-8e9f-69dee58c354e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:01.102669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71633d32-a6be-404b-8e9f-69dee58c354e None admin] PATH_INFO: `/v3/users/fb9c6a88909d4af8a1209102375fca3c` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:01.154000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71633d32-a6be-404b-8e9f-69dee58c354e None admin] RBAC: Authorizing `identity:get_user(user_id=fb9c6a88909d4af8a1209102375fca3c)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:01.157150 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71633d32-a6be-404b-8e9f-69dee58c354e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:01.169287 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 144/278] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:00 2022] GET /identity/v3/users/fb9c6a88909d4af8a1209102375fca3c => generated 293 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:01.170930 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71633d32-a6be-404b-8e9f-69dee58c354e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:01.221706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:01.275469 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39df52c-566a-4f48-b2c1-27d557e7776b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:01.378858 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606cc4d-ae8c-47f9-84b9-7b44ef4f2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:01.379998 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606cc4d-ae8c-47f9-84b9-7b44ef4f2e16 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:01.380507 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606cc4d-ae8c-47f9-84b9-7b44ef4f2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:01.381009 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606cc4d-ae8c-47f9-84b9-7b44ef4f2e16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:01.421417 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606cc4d-ae8c-47f9-84b9-7b44ef4f2e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:01.425331 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71633d32-a6be-404b-8e9f-69dee58c354e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-9606cc4d-ae8c-47f9-84b9-7b44ef4f2e16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:01.444997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:01.448446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:01.451552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:01.457147 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 135/279] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:01.464077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606cc4d-ae8c-47f9-84b9-7b44ef4f2e16 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:01.495269 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c600bd-4439-4f11-a6b8-79ee78bd9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:01.495961 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c600bd-4439-4f11-a6b8-79ee78bd9e80 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:01.496250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c600bd-4439-4f11-a6b8-79ee78bd9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:01.496495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c600bd-4439-4f11-a6b8-79ee78bd9e80 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:01.497898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c600bd-4439-4f11-a6b8-79ee78bd9e80 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:01.499558 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c600bd-4439-4f11-a6b8-79ee78bd9e80 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:01.511800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 145/280] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:01 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:01.511800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c600bd-4439-4f11-a6b8-79ee78bd9e80 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:01.623333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:01.741028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606cc4d-ae8c-47f9-84b9-7b44ef4f2e16 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:01.795029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:01.834584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:01.835800 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:01.836282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:01.836764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:01.839624 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c600bd-4439-4f11-a6b8-79ee78bd9e80 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:01.839845 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] RBAC: Adding query filter params (role.id=5ec05e28e64d4e4b9db1be2d37af117a, user.id=fb9c6a88909d4af8a1209102375fca3c, scope.system=all) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:01.840405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:01.843629 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:01.872274 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 136/281] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Jul 25 20:21:01 2022] GET /identity/v3/role_assignments?user.id=fb9c6a88909d4af8a1209102375fca3c&scope.system=all&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 226 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:01.873013 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:01.911282 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:01.912990 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:01.921190 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:01.921190 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:01.921190 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:01.921190 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:01.922959 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:01.958868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 146/282] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:01.967883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:02.257054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb33e9-bcd2-4885-8fbb-bc9f48abecde None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:02.315716 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:02.334050 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da422fa8-651f-4f41-93bf-e025af717cd5 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:02.382540 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:02.383631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:02.384127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:02.384617 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:02.387054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb, user.id=2ab4b73b1f8046c4965527063df3f49e) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:02.387574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:02.390958 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:02.406726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 137/283] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:21:01 2022] GET /identity/v3/role_assignments?user.id=2ab4b73b1f8046c4965527063df3f49e&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=671de95ce54744059ab540d90d3b40ce => generated 608 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:02.442933 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adbd1f-7ac2-49af-973a-3d20c7f3bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:02.443755 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adbd1f-7ac2-49af-973a-3d20c7f3bf4c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:02.443891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adbd1f-7ac2-49af-973a-3d20c7f3bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:02.444209 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adbd1f-7ac2-49af-973a-3d20c7f3bf4c None admin] PATH_INFO: `/v3/users/e0ebd86398634d64a69f4da34d6f8e63` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:02.450642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adbd1f-7ac2-49af-973a-3d20c7f3bf4c None admin] RBAC: Authorizing `identity:get_user(user_id=e0ebd86398634d64a69f4da34d6f8e63)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:02.453506 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adbd1f-7ac2-49af-973a-3d20c7f3bf4c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:02.457309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 147/284] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:01 2022] GET /identity/v3/users/e0ebd86398634d64a69f4da34d6f8e63 => generated 297 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:02.467088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:02.567836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:02.660755 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486798-48af-4019-b853-a8ac98e26671 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:02.735667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d33f1-c92b-44d1-bfba-9f3dbf746b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:02.736516 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d33f1-c92b-44d1-bfba-9f3dbf746b8a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:02.736802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d33f1-c92b-44d1-bfba-9f3dbf746b8a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:02.737082 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d33f1-c92b-44d1-bfba-9f3dbf746b8a None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:02.742760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d33f1-c92b-44d1-bfba-9f3dbf746b8a None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:02.745881 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d33f1-c92b-44d1-bfba-9f3dbf746b8a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:02.748200 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 138/285] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:02 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:02.756675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adbd1f-7ac2-49af-973a-3d20c7f3bf4c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:02.926420 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adbd1f-7ac2-49af-973a-3d20c7f3bf4c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:02.977802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb53b1-04c8-4215-a3cf-9a66adfd1c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:02.979396 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb53b1-04c8-4215-a3cf-9a66adfd1c5a None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:02.979843 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb53b1-04c8-4215-a3cf-9a66adfd1c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:02.980337 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb53b1-04c8-4215-a3cf-9a66adfd1c5a None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/users/e0ebd86398634d64a69f4da34d6f8e63/roles/a983b54895844492bf712e432403e82e` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:02.987768 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb53b1-04c8-4215-a3cf-9a66adfd1c5a None admin] RBAC: Authorizing `identity:create_grant(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb, user_id=e0ebd86398634d64a69f4da34d6f8e63, role_id=a983b54895844492bf712e432403e82e)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:02.989896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb53b1-04c8-4215-a3cf-9a66adfd1c5a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:03.015515 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 148/286] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:21:02 2022] PUT /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/users/e0ebd86398634d64a69f4da34d6f8e63/roles/a983b54895844492bf712e432403e82e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:21:03.446004 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43491e-b2a8-41a7-b0c6-2519487f2a67 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:03.446615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43491e-b2a8-41a7-b0c6-2519487f2a67 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:03.446615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43491e-b2a8-41a7-b0c6-2519487f2a67 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:03.449975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 139/287] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:03.456890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfa97-2c3d-41a8-98c2-6af3d49395ad None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:03.457662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfa97-2c3d-41a8-98c2-6af3d49395ad None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:03.457662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfa97-2c3d-41a8-98c2-6af3d49395ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:03.486417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-d74bfa97-2c3d-41a8-98c2-6af3d49395ad None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:03.487696 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-d74bfa97-2c3d-41a8-98c2-6af3d49395ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:03.527526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:03.609963 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 149/288] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:03.664185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43491e-b2a8-41a7-b0c6-2519487f2a67 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:03.862345 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43491e-b2a8-41a7-b0c6-2519487f2a67 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:03.905080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:03.951270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8628-6305-4203-8730-e4e61d4dae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:03.952358 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8628-6305-4203-8730-e4e61d4dae40 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:03.952805 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8628-6305-4203-8730-e4e61d4dae40 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:03.953293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8628-6305-4203-8730-e4e61d4dae40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:03.986908 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b8628-6305-4203-8730-e4e61d4dae40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-5a4b8628-6305-4203-8730-e4e61d4dae40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:03.998304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:04.000527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:04.003667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 140/289] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:04.016943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bfa97-2c3d-41a8-98c2-6af3d49395ad None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:04.255715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bfa97-2c3d-41a8-98c2-6af3d49395ad None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:04.359793 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:04.361168 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:04.361662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:04.362122 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:04.363498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:04.364033 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:04.366709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:04.392413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 150/290] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:04.401732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8628-6305-4203-8730-e4e61d4dae40 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:04.692524 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8628-6305-4203-8730-e4e61d4dae40 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:04.787386 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa27a6-4349-48fc-93c2-f1ddcf450066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:04.788391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa27a6-4349-48fc-93c2-f1ddcf450066 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:04.788851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa27a6-4349-48fc-93c2-f1ddcf450066 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:04.789332 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa27a6-4349-48fc-93c2-f1ddcf450066 None admin] PATH_INFO: `/v3/users/eec7d17970174c13898adb69768303bb` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:04.791548 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa27a6-4349-48fc-93c2-f1ddcf450066 None admin] RBAC: Authorizing `identity:get_user(user_id=eec7d17970174c13898adb69768303bb)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:04.793891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa27a6-4349-48fc-93c2-f1ddcf450066 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:04.796945 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 141/291] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:04 2022] GET /identity/v3/users/eec7d17970174c13898adb69768303bb => generated 297 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:04.806668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:04.853580 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:05.028058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b515323-0b82-4eb9-b646-bcfb8fd35507 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:05.028427 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b515323-0b82-4eb9-b646-bcfb8fd35507 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:05.028867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b515323-0b82-4eb9-b646-bcfb8fd35507 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:05.031546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 142/292] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:05.044347 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec860c-2906-40fb-a636-1fc68d7c9c57 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:05.045069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec860c-2906-40fb-a636-1fc68d7c9c57 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:05.045611 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec860c-2906-40fb-a636-1fc68d7c9c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:05.054784 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b4b7c-4a91-45c2-a6e1-7e8933107d6a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:05.074565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-86ec860c-2906-40fb-a636-1fc68d7c9c57 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:05.076243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-86ec860c-2906-40fb-a636-1fc68d7c9c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:05.145794 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:05.175001 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b9459-ca27-4d02-bbb5-1673c1cddfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:05.176174 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b9459-ca27-4d02-bbb5-1673c1cddfb0 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:05.177256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b9459-ca27-4d02-bbb5-1673c1cddfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:05.177554 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b9459-ca27-4d02-bbb5-1673c1cddfb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:05.182834 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 143/293] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:05.208934 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec860c-2906-40fb-a636-1fc68d7c9c57 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:05.370194 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b9459-ca27-4d02-bbb5-1673c1cddfb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:05.373561 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b9459-ca27-4d02-bbb5-1673c1cddfb0 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:05.408800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:05.505347 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec860c-2906-40fb-a636-1fc68d7c9c57 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:05.649938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8a106-12b3-4db5-b8a2-4352345f591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:05.652130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8a106-12b3-4db5-b8a2-4352345f591f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:05.654522 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8a106-12b3-4db5-b8a2-4352345f591f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:05.655708 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8a106-12b3-4db5-b8a2-4352345f591f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:05.684695 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 151/294] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 879 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:05.700124 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b9459-ca27-4d02-bbb5-1673c1cddfb0 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:05.705255 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8a106-12b3-4db5-b8a2-4352345f591f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-bcc8a106-12b3-4db5-b8a2-4352345f591f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:05.729726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:05.731405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:05.733132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:05.738542 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 144/295] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 530 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:05.749217 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8a106-12b3-4db5-b8a2-4352345f591f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:05.844989 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:05.995646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8a106-12b3-4db5-b8a2-4352345f591f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:06.004284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b9459-ca27-4d02-bbb5-1673c1cddfb0 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:06.038993 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:06.086807 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c189a1-0b3f-4821-b185-1d0e2553bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:06.088179 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c189a1-0b3f-4821-b185-1d0e2553bd02 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:06.088814 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c189a1-0b3f-4821-b185-1d0e2553bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:06.089901 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c189a1-0b3f-4821-b185-1d0e2553bd02 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:06.092036 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3171d2-c32f-4fdc-a1c6-ad8db96ce3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:06.092437 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c189a1-0b3f-4821-b185-1d0e2553bd02 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:06.093746 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3171d2-c32f-4fdc-a1c6-ad8db96ce3df None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:06.094490 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3171d2-c32f-4fdc-a1c6-ad8db96ce3df None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:06.095213 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3171d2-c32f-4fdc-a1c6-ad8db96ce3df None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:06.095489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c189a1-0b3f-4821-b185-1d0e2553bd02 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:06.097702 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3171d2-c32f-4fdc-a1c6-ad8db96ce3df None admin] RBAC: Adding query filter params (name=reader) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:06.098569 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3171d2-c32f-4fdc-a1c6-ad8db96ce3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:06.098989 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 152/296] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:05 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:06.101329 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb818d-a6af-4e6c-8859-4ef29f7d80f5 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:06.101893 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb818d-a6af-4e6c-8859-4ef29f7d80f5 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:06.102462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb818d-a6af-4e6c-8859-4ef29f7d80f5 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:06.103098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3171d2-c32f-4fdc-a1c6-ad8db96ce3df None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:06.109166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 153/297] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:06.109166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb818d-a6af-4e6c-8859-4ef29f7d80f5 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:06.133620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 145/298] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:06.133620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9d864-21de-4bc0-b8e1-75571355741e None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:06.133620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9d864-21de-4bc0-b8e1-75571355741e None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:06.133620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9d864-21de-4bc0-b8e1-75571355741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:06.166699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-b5c9d864-21de-4bc0-b8e1-75571355741e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:06.169031 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-b5c9d864-21de-4bc0-b8e1-75571355741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:06.330613 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 146/299] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:06.339612 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9d864-21de-4bc0-b8e1-75571355741e None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:06.342327 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb818d-a6af-4e6c-8859-4ef29f7d80f5 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:06.423817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:06.424600 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:06.425083 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:06.425284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:06.426144 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] RBAC: Adding query filter params (role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb, user.id=eec7d17970174c13898adb69768303bb) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:06.426521 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:06.428386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:06.437042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:06.445704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 154/300] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:21:06 2022] GET /identity/v3/role_assignments?user.id=eec7d17970174c13898adb69768303bb&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:06.446804 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:06.580319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:06.647641 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9d864-21de-4bc0-b8e1-75571355741e None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:06.739814 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3c9a-ad4a-4d29-aab2-1dc36073e27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:06.742775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3c9a-ad4a-4d29-aab2-1dc36073e27c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:06.743625 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3c9a-ad4a-4d29-aab2-1dc36073e27c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:06.745169 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3c9a-ad4a-4d29-aab2-1dc36073e27c None admin] PATH_INFO: `/v3/users/28046cdabce14ef0bcfa4eb27d0a7520` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:06.777042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179d57-b657-4afe-88d3-1b3ec510cba3 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:06.781028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a3c9a-ad4a-4d29-aab2-1dc36073e27c None admin] RBAC: Authorizing `identity:get_user(user_id=28046cdabce14ef0bcfa4eb27d0a7520)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:06.786037 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a3c9a-ad4a-4d29-aab2-1dc36073e27c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:06.789936 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 147/301] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:06 2022] GET /identity/v3/users/28046cdabce14ef0bcfa4eb27d0a7520 => generated 293 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:06.805893 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3c9a-ad4a-4d29-aab2-1dc36073e27c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:06.880411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a753221-8fa6-4a9b-a1b0-681f4a7a237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:06.882167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753221-8fa6-4a9b-a1b0-681f4a7a237c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:06.882983 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753221-8fa6-4a9b-a1b0-681f4a7a237c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:06.883757 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753221-8fa6-4a9b-a1b0-681f4a7a237c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:06.888754 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753221-8fa6-4a9b-a1b0-681f4a7a237c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:06.892118 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753221-8fa6-4a9b-a1b0-681f4a7a237c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:06.897745 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 155/302] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:06.906207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a753221-8fa6-4a9b-a1b0-681f4a7a237c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:07.012046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:07.049599 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3c9a-ad4a-4d29-aab2-1dc36073e27c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:07.125613 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36591e87-4e91-48ff-bade-a085f59ef596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:07.126723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591e87-4e91-48ff-bade-a085f59ef596 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:07.127235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591e87-4e91-48ff-bade-a085f59ef596 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:07.128200 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36591e87-4e91-48ff-bade-a085f59ef596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:07.129481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36591e87-4e91-48ff-bade-a085f59ef596 None admin] RBAC: Adding query filter params (role.id=a983b54895844492bf712e432403e82e, user.id=28046cdabce14ef0bcfa4eb27d0a7520, scope.system=all) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:07.129864 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36591e87-4e91-48ff-bade-a085f59ef596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:07.132702 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36591e87-4e91-48ff-bade-a085f59ef596 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:07.140774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a753221-8fa6-4a9b-a1b0-681f4a7a237c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:07.144264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 148/303] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Jul 25 20:21:06 2022] GET /identity/v3/role_assignments?user.id=28046cdabce14ef0bcfa4eb27d0a7520&scope.system=all&role.id=a983b54895844492bf712e432403e82e => generated 226 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:07.156066 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e336fc-9b1b-40bb-ad38-6f7006400e7a None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:07.156678 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e336fc-9b1b-40bb-ad38-6f7006400e7a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:07.157383 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e336fc-9b1b-40bb-ad38-6f7006400e7a None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:07.161820 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 149/304] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:07 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:07.167939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfc2d-fe42-469e-bc9c-cb7eae6809f3 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:07.168252 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfc2d-fe42-469e-bc9c-cb7eae6809f3 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:07.168534 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfc2d-fe42-469e-bc9c-cb7eae6809f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:07.178522 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:07.195683 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-51abfc2d-fe42-469e-bc9c-cb7eae6809f3 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:07.198443 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-51abfc2d-fe42-469e-bc9c-cb7eae6809f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:07.221955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f82de-7c22-4446-b2ab-13075f427a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:07.222944 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f82de-7c22-4446-b2ab-13075f427a3a None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:07.223658 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f82de-7c22-4446-b2ab-13075f427a3a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:07.224257 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f82de-7c22-4446-b2ab-13075f427a3a None admin] PATH_INFO: `/v3/groups` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:07.225206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f82de-7c22-4446-b2ab-13075f427a3a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:07.227058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f82de-7c22-4446-b2ab-13075f427a3a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:07.258649 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 156/305] 10.222.0.47 () {60 vars in 1134 bytes} [Mon Jul 25 20:21:06 2022] POST /identity/v3/groups => generated 229 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:21:07.345396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 150/306] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:07.372321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f82de-7c22-4446-b2ab-13075f427a3a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:07.560588 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f82de-7c22-4446-b2ab-13075f427a3a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:07.589515 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308d16-e486-4ad7-8b5a-91227d84fd06 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:07.589945 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308d16-e486-4ad7-8b5a-91227d84fd06 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:07.590426 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308d16-e486-4ad7-8b5a-91227d84fd06 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:07.595112 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 151/307] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:21:07.602250 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796e78-4ec7-4656-ba22-306b0f977999 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:07.602748 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796e78-4ec7-4656-ba22-306b0f977999 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:07.603795 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796e78-4ec7-4656-ba22-306b0f977999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:07.621141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea7c2-cb98-4398-82b3-8a0c12d036c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:07.621141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea7c2-cb98-4398-82b3-8a0c12d036c3 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:07.621636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea7c2-cb98-4398-82b3-8a0c12d036c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:07.622141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea7c2-cb98-4398-82b3-8a0c12d036c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:07.634544 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-28796e78-4ec7-4656-ba22-306b0f977999 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:07.636114 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-28796e78-4ec7-4656-ba22-306b0f977999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:07.646553 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea7c2-cb98-4398-82b3-8a0c12d036c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-828ea7c2-cb98-4398-82b3-8a0c12d036c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:07.651924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:07.654064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:07.655659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 157/308] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:21:07.669482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea7c2-cb98-4398-82b3-8a0c12d036c3 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:07.761440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:07.827674 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 152/309] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:07.870763 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28796e78-4ec7-4656-ba22-306b0f977999 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:07.894914 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:07.910251 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea7c2-cb98-4398-82b3-8a0c12d036c3 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:07.985417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:07.986531 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:07.987015 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:07.987496 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:07.988856 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:07.989458 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:07.992173 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:08.015844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 158/310] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:08.023909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:08.126306 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28796e78-4ec7-4656-ba22-306b0f977999 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:08.202592 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a298858-f537-418f-9694-264dfbdd1d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:08.204365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a298858-f537-418f-9694-264dfbdd1d5c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:08.205307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a298858-f537-418f-9694-264dfbdd1d5c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:08.206068 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a298858-f537-418f-9694-264dfbdd1d5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:08.234838 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a298858-f537-418f-9694-264dfbdd1d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:08.245223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-3a298858-f537-418f-9694-264dfbdd1d5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:08.254742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:08.256842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:08.258747 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:08.263286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 153/311] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:21:08.266435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ac4bc-adec-4be7-9eca-8a8377a0d7d3 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:08.274415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a298858-f537-418f-9694-264dfbdd1d5c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:08.360287 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd64168-1c7f-4b78-9eeb-ca6c766eb214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:08.361920 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd64168-1c7f-4b78-9eeb-ca6c766eb214 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:08.362626 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd64168-1c7f-4b78-9eeb-ca6c766eb214 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:08.363333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd64168-1c7f-4b78-9eeb-ca6c766eb214 None admin] PATH_INFO: `/v3/users/fb9c6a88909d4af8a1209102375fca3c` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:08.366155 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd64168-1c7f-4b78-9eeb-ca6c766eb214 None admin] RBAC: Authorizing `identity:get_user(user_id=fb9c6a88909d4af8a1209102375fca3c)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:08.370018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd64168-1c7f-4b78-9eeb-ca6c766eb214 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:08.382035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 159/312] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:08 2022] GET /identity/v3/users/fb9c6a88909d4af8a1209102375fca3c => generated 293 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:08.387116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd64168-1c7f-4b78-9eeb-ca6c766eb214 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:08.442716 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:08.514702 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a298858-f537-418f-9694-264dfbdd1d5c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:08.596199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:08.598318 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:08.598318 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:08.598672 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:08.600134 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:08.600649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:08.603637 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:08.627744 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 154/313] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:08.629096 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd64168-1c7f-4b78-9eeb-ca6c766eb214 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:08.632971 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:08.704940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f720194-1b67-432a-81b8-c1de4f084c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:08.706605 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720194-1b67-432a-81b8-c1de4f084c63 None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:08.707388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720194-1b67-432a-81b8-c1de4f084c63 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:08.708230 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720194-1b67-432a-81b8-c1de4f084c63 None admin] PATH_INFO: `/v3/system/users/fb9c6a88909d4af8a1209102375fca3c/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:08.711618 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f720194-1b67-432a-81b8-c1de4f084c63 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fb9c6a88909d4af8a1209102375fca3c, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:08.715122 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f720194-1b67-432a-81b8-c1de4f084c63 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:08.737696 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 160/314] 10.222.0.47 () {58 vars in 1334 bytes} [Mon Jul 25 20:21:08 2022] PUT /identity/v3/system/users/fb9c6a88909d4af8a1209102375fca3c/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:21:08.857962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961677-6789-4c59-9239-06628311cb36 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:08.923883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:08.934455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ed4ac-b1dd-43f1-9d85-9fbdc9bc6cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:08.935602 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ed4ac-b1dd-43f1-9d85-9fbdc9bc6cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:08.936466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ed4ac-b1dd-43f1-9d85-9fbdc9bc6cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:08.937651 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ed4ac-b1dd-43f1-9d85-9fbdc9bc6cd4 None admin] PATH_INFO: `/v3/users/e0ebd86398634d64a69f4da34d6f8e63` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:08.940154 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ed4ac-b1dd-43f1-9d85-9fbdc9bc6cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ebd86398634d64a69f4da34d6f8e63)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:08.943001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ed4ac-b1dd-43f1-9d85-9fbdc9bc6cd4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:08.954869 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 155/315] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:08 2022] GET /identity/v3/users/e0ebd86398634d64a69f4da34d6f8e63 => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:08.964583 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f720194-1b67-432a-81b8-c1de4f084c63 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:09.027298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:09.189512 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f720194-1b67-432a-81b8-c1de4f084c63 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:09.238243 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71572eb9-0ecb-46aa-b9d2-6e9a9b2085f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:09.239281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572eb9-0ecb-46aa-b9d2-6e9a9b2085f2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:09.239809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572eb9-0ecb-46aa-b9d2-6e9a9b2085f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:09.240300 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572eb9-0ecb-46aa-b9d2-6e9a9b2085f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:09.335909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71572eb9-0ecb-46aa-b9d2-6e9a9b2085f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:09.339102 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71572eb9-0ecb-46aa-b9d2-6e9a9b2085f2 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:09.382658 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:09.544868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 161/316] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 20:21:09.554499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ed4ac-b1dd-43f1-9d85-9fbdc9bc6cd4 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:09.777131 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ed4ac-b1dd-43f1-9d85-9fbdc9bc6cd4 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:09.850989 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e8891-84fd-41da-8483-c9e4759050c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:09.852128 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8891-84fd-41da-8483-c9e4759050c0 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:09.852699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8891-84fd-41da-8483-c9e4759050c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:09.853843 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e8891-84fd-41da-8483-c9e4759050c0 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:09.856280 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e8891-84fd-41da-8483-c9e4759050c0 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:09.859110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e8891-84fd-41da-8483-c9e4759050c0 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:09.862993 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 156/317] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:09 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:09.874088 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71572eb9-0ecb-46aa-b9d2-6e9a9b2085f2 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:10.082007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71572eb9-0ecb-46aa-b9d2-6e9a9b2085f2 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:10.122130 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:10.138151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef93e0b-98ef-425f-8a1f-5ecd980ead7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:10.139360 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef93e0b-98ef-425f-8a1f-5ecd980ead7f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:10.139996 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef93e0b-98ef-425f-8a1f-5ecd980ead7f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:10.140285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef93e0b-98ef-425f-8a1f-5ecd980ead7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:10.141678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef93e0b-98ef-425f-8a1f-5ecd980ead7f None admin] RBAC: Adding query filter params (role.id=a983b54895844492bf712e432403e82e, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb, user.id=e0ebd86398634d64a69f4da34d6f8e63) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:10.142021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef93e0b-98ef-425f-8a1f-5ecd980ead7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:10.143639 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef93e0b-98ef-425f-8a1f-5ecd980ead7f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:10.157732 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 162/318] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:21:09 2022] GET /identity/v3/role_assignments?user.id=e0ebd86398634d64a69f4da34d6f8e63&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=a983b54895844492bf712e432403e82e => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:11.208948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7267-0b86-4911-b70e-20eacf9764f9 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:11.209848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7267-0b86-4911-b70e-20eacf9764f9 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:11.210000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7267-0b86-4911-b70e-20eacf9764f9 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:11.213025 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 157/319] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:21:11.224856 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694e9b-425c-4f4b-94f9-dc64c041b94e None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:11.225663 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694e9b-425c-4f4b-94f9-dc64c041b94e None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:11.225663 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694e9b-425c-4f4b-94f9-dc64c041b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:11.263615 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-fb694e9b-425c-4f4b-94f9-dc64c041b94e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:11.265133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-fb694e9b-425c-4f4b-94f9-dc64c041b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:11.367244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff3b5-36f3-4e95-b26f-5b8ebf5e5073 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:11.367679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff3b5-36f3-4e95-b26f-5b8ebf5e5073 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:11.368093 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff3b5-36f3-4e95-b26f-5b8ebf5e5073 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:11.371286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 158/320] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:11.380931 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b22d0-981d-473c-b0c1-6bb656eccb3e None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:11.381466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b22d0-981d-473c-b0c1-6bb656eccb3e None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:11.381952 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b22d0-981d-473c-b0c1-6bb656eccb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:11.419957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-6a7b22d0-981d-473c-b0c1-6bb656eccb3e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:11.422167 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-6a7b22d0-981d-473c-b0c1-6bb656eccb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:11.449969 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 163/321] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:11.489319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694e9b-425c-4f4b-94f9-dc64c041b94e None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:11.543401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:11.560911 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 159/322] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:11.600732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b22d0-981d-473c-b0c1-6bb656eccb3e None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:11.731607 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694e9b-425c-4f4b-94f9-dc64c041b94e None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:11.794586 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:11.817506 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b22d0-981d-473c-b0c1-6bb656eccb3e None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:11.817903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047524b-90aa-4ef3-84b8-f761d5395892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:11.818872 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047524b-90aa-4ef3-84b8-f761d5395892 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:11.819317 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047524b-90aa-4ef3-84b8-f761d5395892 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:11.819772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047524b-90aa-4ef3-84b8-f761d5395892 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:11.839360 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047524b-90aa-4ef3-84b8-f761d5395892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-7047524b-90aa-4ef3-84b8-f761d5395892 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:11.847747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:11.849936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:11.852134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 164/323] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:21:11.858479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047524b-90aa-4ef3-84b8-f761d5395892 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:11.895837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59565d-d8d7-4ebd-9868-f2236f9bc989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:11.896777 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59565d-d8d7-4ebd-9868-f2236f9bc989 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:11.897453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59565d-d8d7-4ebd-9868-f2236f9bc989 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:11.897839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59565d-d8d7-4ebd-9868-f2236f9bc989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:11.901511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59565d-d8d7-4ebd-9868-f2236f9bc989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:11.903798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59565d-d8d7-4ebd-9868-f2236f9bc989 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:11.906791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 160/324] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:11.917291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59565d-d8d7-4ebd-9868-f2236f9bc989 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:12.052161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047524b-90aa-4ef3-84b8-f761d5395892 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:12.073944 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:12.139523 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:12.140641 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:12.143502 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:12.143502 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:12.143502 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:12.143927 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:12.144053 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59565d-d8d7-4ebd-9868-f2236f9bc989 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:12.145685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:12.162629 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 165/325] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:12.166784 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:12.216356 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc8830-6aa7-4c4c-98a2-eb9a8c0c98f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:12.217659 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8830-6aa7-4c4c-98a2-eb9a8c0c98f8 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:12.218159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8830-6aa7-4c4c-98a2-eb9a8c0c98f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:12.218689 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8830-6aa7-4c4c-98a2-eb9a8c0c98f8 None admin] PATH_INFO: `/v3/groups` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:12.219595 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc8830-6aa7-4c4c-98a2-eb9a8c0c98f8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:12.222512 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc8830-6aa7-4c4c-98a2-eb9a8c0c98f8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:12.257470 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 161/326] 10.222.0.47 () {60 vars in 1134 bytes} [Mon Jul 25 20:21:11 2022] POST /identity/v3/groups => generated 226 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:21:12.268245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:12.408914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9022d-d939-4782-a253-171038661b38 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:12.477640 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d857b0-2ece-4465-8dca-c8ff21b4bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:12.479417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d857b0-2ece-4465-8dca-c8ff21b4bd0f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:12.479860 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d857b0-2ece-4465-8dca-c8ff21b4bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:12.480371 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d857b0-2ece-4465-8dca-c8ff21b4bd0f None admin] PATH_INFO: `/v3/users/28046cdabce14ef0bcfa4eb27d0a7520` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:12.483003 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d857b0-2ece-4465-8dca-c8ff21b4bd0f None admin] RBAC: Authorizing `identity:get_user(user_id=28046cdabce14ef0bcfa4eb27d0a7520)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:12.486545 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d857b0-2ece-4465-8dca-c8ff21b4bd0f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:12.489596 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 166/327] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:12 2022] GET /identity/v3/users/28046cdabce14ef0bcfa4eb27d0a7520 => generated 293 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:12.497557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc8830-6aa7-4c4c-98a2-eb9a8c0c98f8 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:12.659836 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c8c4-7d88-4342-9eda-ec4451588915 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:12.660207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c8c4-7d88-4342-9eda-ec4451588915 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:12.660582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c8c4-7d88-4342-9eda-ec4451588915 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:12.662829 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 167/328] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:21:12.673878 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd607f09-7401-48df-95b2-5c8cb9933876 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:12.674374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd607f09-7401-48df-95b2-5c8cb9933876 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:12.674873 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd607f09-7401-48df-95b2-5c8cb9933876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:12.711659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-cd607f09-7401-48df-95b2-5c8cb9933876 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:12.714788 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-cd607f09-7401-48df-95b2-5c8cb9933876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:12.726763 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc8830-6aa7-4c4c-98a2-eb9a8c0c98f8 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:12.788200 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:12.820391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7511d75-fb74-4f6e-8a92-726efe1c4735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:12.820391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7511d75-fb74-4f6e-8a92-726efe1c4735 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:12.820391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7511d75-fb74-4f6e-8a92-726efe1c4735 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:12.820391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7511d75-fb74-4f6e-8a92-726efe1c4735 None admin] PATH_INFO: `/v3/system/users/28046cdabce14ef0bcfa4eb27d0a7520/roles/a983b54895844492bf712e432403e82e` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:12.821133 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7511d75-fb74-4f6e-8a92-726efe1c4735 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=28046cdabce14ef0bcfa4eb27d0a7520, role_id=a983b54895844492bf712e432403e82e)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:12.827249 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7511d75-fb74-4f6e-8a92-726efe1c4735 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:12.841376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 162/329] 10.222.0.47 () {58 vars in 1334 bytes} [Mon Jul 25 20:21:12 2022] PUT /identity/v3/system/users/28046cdabce14ef0bcfa4eb27d0a7520/roles/a983b54895844492bf712e432403e82e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:21:12.879225 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 168/330] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:12.928307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7511d75-fb74-4f6e-8a92-726efe1c4735 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:13.155065 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7511d75-fb74-4f6e-8a92-726efe1c4735 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:13.250708 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4169247-bc1e-41b2-8550-8e35bfdd8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:13.251664 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169247-bc1e-41b2-8550-8e35bfdd8d36 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:13.254524 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169247-bc1e-41b2-8550-8e35bfdd8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:13.254524 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169247-bc1e-41b2-8550-8e35bfdd8d36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:13.279036 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4169247-bc1e-41b2-8550-8e35bfdd8d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-f4169247-bc1e-41b2-8550-8e35bfdd8d36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:13.291148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:13.293413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:13.296645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 163/331] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:13.301912 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd607f09-7401-48df-95b2-5c8cb9933876 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:13.432752 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:13.571563 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd607f09-7401-48df-95b2-5c8cb9933876 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:13.642059 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:13.642801 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:13.643141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:13.643429 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:13.644251 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:13.644566 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:13.646572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:13.662130 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 169/332] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:13.672772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4169247-bc1e-41b2-8550-8e35bfdd8d36 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:13.835792 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:13.981736 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4169247-bc1e-41b2-8550-8e35bfdd8d36 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:14.099806 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade23a4-7d34-444a-bae5-095d0f9e2636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:14.100897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade23a4-7d34-444a-bae5-095d0f9e2636 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:14.101454 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade23a4-7d34-444a-bae5-095d0f9e2636 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:14.102061 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade23a4-7d34-444a-bae5-095d0f9e2636 None admin] PATH_INFO: `/v3/users/fb9c6a88909d4af8a1209102375fca3c` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:14.104992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade23a4-7d34-444a-bae5-095d0f9e2636 None admin] RBAC: Authorizing `identity:get_user(user_id=fb9c6a88909d4af8a1209102375fca3c)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:14.108014 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade23a4-7d34-444a-bae5-095d0f9e2636 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:14.111252 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 164/333] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:13 2022] GET /identity/v3/users/fb9c6a88909d4af8a1209102375fca3c => generated 293 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:14.119716 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:14.434338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d48748-8565-47a0-8fd0-b5dbf8dc7e7e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:14.443303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:14.522964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189abbf-f28f-4a7f-8c63-baf1642bb928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:14.523865 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189abbf-f28f-4a7f-8c63-baf1642bb928 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:14.524230 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189abbf-f28f-4a7f-8c63-baf1642bb928 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:14.524675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189abbf-f28f-4a7f-8c63-baf1642bb928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:14.526441 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189abbf-f28f-4a7f-8c63-baf1642bb928 None admin] RBAC: Adding query filter params (role.id=5ec05e28e64d4e4b9db1be2d37af117a, user.id=fb9c6a88909d4af8a1209102375fca3c, scope.system=all) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:14.526860 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189abbf-f28f-4a7f-8c63-baf1642bb928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:14.528614 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189abbf-f28f-4a7f-8c63-baf1642bb928 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:14.550963 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 170/334] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Jul 25 20:21:14 2022] GET /identity/v3/role_assignments?user.id=fb9c6a88909d4af8a1209102375fca3c&scope.system=all&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 510 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:18.140797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851735-853a-450f-86ba-22690d46a1a3 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:18.142485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851735-853a-450f-86ba-22690d46a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:18.143266 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851735-853a-450f-86ba-22690d46a1a3 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:18.146260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 165/335] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:18.156124 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568719-b4e2-43ad-89a7-03d5d8597128 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:18.156866 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568719-b4e2-43ad-89a7-03d5d8597128 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:18.157174 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568719-b4e2-43ad-89a7-03d5d8597128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:18.197735 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-88568719-b4e2-43ad-89a7-03d5d8597128 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:18.199238 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-88568719-b4e2-43ad-89a7-03d5d8597128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:18.305867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3f4fa-a635-4a04-93fb-c9b0df0d42bf None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:18.306918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3f4fa-a635-4a04-93fb-c9b0df0d42bf None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:18.307653 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3f4fa-a635-4a04-93fb-c9b0df0d42bf None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:18.312546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 166/336] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:18.321471 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571458a6-7d35-432d-913e-0e2d1a1fbb02 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:18.322421 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571458a6-7d35-432d-913e-0e2d1a1fbb02 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:18.323170 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571458a6-7d35-432d-913e-0e2d1a1fbb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:18.385375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 171/337] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:18.398763 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-571458a6-7d35-432d-913e-0e2d1a1fbb02 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:18.401836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-571458a6-7d35-432d-913e-0e2d1a1fbb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:18.459483 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a32880-17e9-4ab4-bd71-583fa02deb42 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:18.460439 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a32880-17e9-4ab4-bd71-583fa02deb42 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:18.461279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a32880-17e9-4ab4-bd71-583fa02deb42 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:18.465086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 172/338] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:21:18.474889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793795c4-df85-4f0d-8a6b-0664f9e598eb None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:18.475375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793795c4-df85-4f0d-8a6b-0664f9e598eb None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:18.475818 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793795c4-df85-4f0d-8a6b-0664f9e598eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:18.531052 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-793795c4-df85-4f0d-8a6b-0664f9e598eb None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:18.533790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-793795c4-df85-4f0d-8a6b-0664f9e598eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:18.606746 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 167/339] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:18.609520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571458a6-7d35-432d-913e-0e2d1a1fbb02 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:18.712907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 173/340] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:18.715263 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ce7b8-82a7-420a-8769-e8a8bfd060fc None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:18.716131 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ce7b8-82a7-420a-8769-e8a8bfd060fc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:18.716862 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ce7b8-82a7-420a-8769-e8a8bfd060fc None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:18.719330 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 174/341] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:18.721201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ce7b8-82a7-420a-8769-e8a8bfd060fc None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:18.744668 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:18.768932 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:18.865466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571458a6-7d35-432d-913e-0e2d1a1fbb02 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:18.942025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ce7b8-82a7-420a-8769-e8a8bfd060fc None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:18.947956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb86e5-9acb-4068-aa06-a943a5b49c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:18.949548 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb86e5-9acb-4068-aa06-a943a5b49c80 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:18.955167 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb86e5-9acb-4068-aa06-a943a5b49c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:18.955167 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb86e5-9acb-4068-aa06-a943a5b49c80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:18.985062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb86e5-9acb-4068-aa06-a943a5b49c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-18fb86e5-9acb-4068-aa06-a943a5b49c80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:18.997300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:18.998539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:18.999344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:19.006373 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 168/342] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:19.010154 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492817d5-777a-4931-8190-e59ddddbe5bb None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:19.010673 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492817d5-777a-4931-8190-e59ddddbe5bb None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:19.011362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492817d5-777a-4931-8190-e59ddddbe5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:19.026623 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cae0c-9804-48f8-a657-dc3df2183f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:19.027600 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cae0c-9804-48f8-a657-dc3df2183f7f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:19.027935 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cae0c-9804-48f8-a657-dc3df2183f7f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:19.028429 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cae0c-9804-48f8-a657-dc3df2183f7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:19.050408 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-492817d5-777a-4931-8190-e59ddddbe5bb None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:19.051972 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-492817d5-777a-4931-8190-e59ddddbe5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:19.073309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cae0c-9804-48f8-a657-dc3df2183f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-df8cae0c-9804-48f8-a657-dc3df2183f7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:19.080023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:19.081736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 20:21:19.083274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:19.084483 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 175/343] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:19.089169 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cae0c-9804-48f8-a657-dc3df2183f7f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:19.182276 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 169/344] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:19.183688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492817d5-777a-4931-8190-e59ddddbe5bb None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:19.258011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:19.292314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cae0c-9804-48f8-a657-dc3df2183f7f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:19.294950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:19.375175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1e42-ea91-4fa3-8934-6da470ddebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:19.376363 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1e42-ea91-4fa3-8934-6da470ddebf8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:19.377148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1e42-ea91-4fa3-8934-6da470ddebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:19.377840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1e42-ea91-4fa3-8934-6da470ddebf8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:19.398988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d1e42-ea91-4fa3-8934-6da470ddebf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-975d1e42-ea91-4fa3-8934-6da470ddebf8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:19.415798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:19.417977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 176/345] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:19.422524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1e42-ea91-4fa3-8934-6da470ddebf8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:19.427678 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492817d5-777a-4931-8190-e59ddddbe5bb None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:19.499939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:19.499939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:19.499939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:19.499939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:19.500519 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] RBAC: Adding query filter params (name=member) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:19.500519 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:19.502347 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:19.531591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 170/346] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:19.533694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:19.694471 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1e42-ea91-4fa3-8934-6da470ddebf8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:19.769999 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:19.770978 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:19.771450 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:19.771943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:19.776031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:19.776265 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:19.776675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:19.779388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:19.785012 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397608a-7047-4b59-9727-41847710f5ac None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:19.798177 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 177/347] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:19.799647 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:19.813203 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:19.877403 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bc11b-f0a9-496f-b1f7-5c7726b1b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:19.878514 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc11b-f0a9-496f-b1f7-5c7726b1b8bd None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:19.879089 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc11b-f0a9-496f-b1f7-5c7726b1b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:19.879665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc11b-f0a9-496f-b1f7-5c7726b1b8bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:19.903545 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bc11b-f0a9-496f-b1f7-5c7726b1b8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-e42bc11b-f0a9-496f-b1f7-5c7726b1b8bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:19.914162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:19.916520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:19.918628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:19.923947 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 171/348] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:21:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:19.923947 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bc11b-f0a9-496f-b1f7-5c7726b1b8bd None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:20.010032 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac94c-1346-4715-bb42-0048dde2136e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:20.099482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:20.100611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:20.101135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:20.101650 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:20.103578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:20.104128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:20.106741 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:20.129236 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 178/349] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:20.130956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:20.189096 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bc11b-f0a9-496f-b1f7-5c7726b1b8bd None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:20.266638 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:20.279710 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d6179-9c2b-488b-9fb4-3ebc33620c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:20.281092 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6179-9c2b-488b-9fb4-3ebc33620c68 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:20.281738 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6179-9c2b-488b-9fb4-3ebc33620c68 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:20.283343 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6179-9c2b-488b-9fb4-3ebc33620c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:20.339660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3cb31-3388-40a2-ad04-5ac93026ce99 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:20.364775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:20.406787 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55658c-cbd1-4633-8e49-c1801aa6d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:20.408203 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55658c-cbd1-4633-8e49-c1801aa6d8db None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:20.408712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55658c-cbd1-4633-8e49-c1801aa6d8db None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:20.409259 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55658c-cbd1-4633-8e49-c1801aa6d8db None admin] PATH_INFO: `/v3/users/28046cdabce14ef0bcfa4eb27d0a7520` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:20.411528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55658c-cbd1-4633-8e49-c1801aa6d8db None admin] RBAC: Authorizing `identity:get_user(user_id=28046cdabce14ef0bcfa4eb27d0a7520)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:20.413887 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55658c-cbd1-4633-8e49-c1801aa6d8db None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:20.422907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 179/350] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 20:21:20 2022] GET /identity/v3/users/28046cdabce14ef0bcfa4eb27d0a7520 => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:20.422907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55658c-cbd1-4633-8e49-c1801aa6d8db None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:20.464187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d6179-9c2b-488b-9fb4-3ebc33620c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:20.466579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d6179-9c2b-488b-9fb4-3ebc33620c68 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:20.636139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55658c-cbd1-4633-8e49-c1801aa6d8db None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:20.689163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 172/351] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:20.689883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d6179-9c2b-488b-9fb4-3ebc33620c68 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:20.715498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e032c10-6e5d-40b0-9694-65f9e6d0d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:20.715498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032c10-6e5d-40b0-9694-65f9e6d0d5ea None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:20.715498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032c10-6e5d-40b0-9694-65f9e6d0d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:20.715498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032c10-6e5d-40b0-9694-65f9e6d0d5ea None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:20.716332 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e032c10-6e5d-40b0-9694-65f9e6d0d5ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:20.716332 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e032c10-6e5d-40b0-9694-65f9e6d0d5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:20.716969 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e032c10-6e5d-40b0-9694-65f9e6d0d5ea None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:20.721494 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:20.730676 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 180/352] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:20.735565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c56f6-922d-4651-be99-2f850c5a8306 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:20.735565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c56f6-922d-4651-be99-2f850c5a8306 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:20.735565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c56f6-922d-4651-be99-2f850c5a8306 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:20.735565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 181/353] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:20.735565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c56f6-922d-4651-be99-2f850c5a8306 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:20.815118 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:20.896952 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d6179-9c2b-488b-9fb4-3ebc33620c68 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:20.967274 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5351bd-4542-4191-b031-a442b8f600f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:20.973956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5351bd-4542-4191-b031-a442b8f600f5 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:20.973956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5351bd-4542-4191-b031-a442b8f600f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:20.973956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5351bd-4542-4191-b031-a442b8f600f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:20.974480 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c56f6-922d-4651-be99-2f850c5a8306 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:21.048439 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5db521-6466-4ecd-b6b3-2993e3e0e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:21.053210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5db521-6466-4ecd-b6b3-2993e3e0e572 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:21.053210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5db521-6466-4ecd-b6b3-2993e3e0e572 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:21.053210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5db521-6466-4ecd-b6b3-2993e3e0e572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:21.053731 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5db521-6466-4ecd-b6b3-2993e3e0e572 None admin] RBAC: Adding query filter params (role.id=a983b54895844492bf712e432403e82e, user.id=28046cdabce14ef0bcfa4eb27d0a7520, scope.system=all) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:21.054037 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5db521-6466-4ecd-b6b3-2993e3e0e572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:21.058283 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5db521-6466-4ecd-b6b3-2993e3e0e572 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:21.096898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 182/354] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Jul 25 20:21:20 2022] GET /identity/v3/role_assignments?user.id=28046cdabce14ef0bcfa4eb27d0a7520&scope.system=all&role.id=a983b54895844492bf712e432403e82e => generated 510 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:21.096898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef48dd7-7473-45c0-a17f-41a934093d46 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:21.096898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef48dd7-7473-45c0-a17f-41a934093d46 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:21.096898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef48dd7-7473-45c0-a17f-41a934093d46 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:21.096898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 183/355] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:21.098321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef48dd7-7473-45c0-a17f-41a934093d46 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:21.128200 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5351bd-4542-4191-b031-a442b8f600f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:21.132705 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5351bd-4542-4191-b031-a442b8f600f5 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:21.242413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:21.286940 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:21.340413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef48dd7-7473-45c0-a17f-41a934093d46 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:21.398160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 173/356] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:21.400938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5351bd-4542-4191-b031-a442b8f600f5 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:21.421295 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d159bc-687c-4081-b64c-8a9aac00ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:21.422409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d159bc-687c-4081-b64c-8a9aac00ac1e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:21.422919 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d159bc-687c-4081-b64c-8a9aac00ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:21.423415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d159bc-687c-4081-b64c-8a9aac00ac1e None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:21.429770 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d159bc-687c-4081-b64c-8a9aac00ac1e None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:21.432847 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d159bc-687c-4081-b64c-8a9aac00ac1e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:21.441080 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 184/357] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:21 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:21.441080 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46b094-7555-4d44-af2f-1b12cb19d16a None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:21.441080 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46b094-7555-4d44-af2f-1b12cb19d16a None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:21.441080 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46b094-7555-4d44-af2f-1b12cb19d16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:21.474287 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-4a46b094-7555-4d44-af2f-1b12cb19d16a None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:21.476467 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4a46b094-7555-4d44-af2f-1b12cb19d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:21.627775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 185/358] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:21.630931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446087-3746-4341-8830-4355cee2c9ed None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:21.631778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446087-3746-4341-8830-4355cee2c9ed None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:21.632251 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446087-3746-4341-8830-4355cee2c9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:21.658360 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5351bd-4542-4191-b031-a442b8f600f5 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:21.684302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-de446087-3746-4341-8830-4355cee2c9ed None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:21.686404 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-de446087-3746-4341-8830-4355cee2c9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:21.723588 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7850b-8a5e-4827-91e6-0b953fec4f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:21.724439 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7850b-8a5e-4827-91e6-0b953fec4f02 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:21.725772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7850b-8a5e-4827-91e6-0b953fec4f02 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:21.725772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7850b-8a5e-4827-91e6-0b953fec4f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:21.781980 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:21.802043 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:21.843628 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 186/359] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:21.845461 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de446087-3746-4341-8830-4355cee2c9ed None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:21.880294 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7850b-8a5e-4827-91e6-0b953fec4f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:21.883193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7850b-8a5e-4827-91e6-0b953fec4f02 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:22.068005 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de446087-3746-4341-8830-4355cee2c9ed None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:22.126335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 174/360] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:22.127090 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7850b-8a5e-4827-91e6-0b953fec4f02 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:22.160366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deb65e-0487-4b5e-ae41-2f44eed69f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:22.161857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb65e-0487-4b5e-ae41-2f44eed69f83 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:22.162354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb65e-0487-4b5e-ae41-2f44eed69f83 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:22.163035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deb65e-0487-4b5e-ae41-2f44eed69f83 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:22.166475 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deb65e-0487-4b5e-ae41-2f44eed69f83 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:22.170062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deb65e-0487-4b5e-ae41-2f44eed69f83 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:22.173504 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 187/361] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:21 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:22.175053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deb65e-0487-4b5e-ae41-2f44eed69f83 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:22.256904 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:22.296520 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:22.344512 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7850b-8a5e-4827-91e6-0b953fec4f02 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:22.402326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1178ef-8b30-414f-b2a3-d272334a5e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:22.402997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1178ef-8b30-414f-b2a3-d272334a5e5f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:22.403330 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1178ef-8b30-414f-b2a3-d272334a5e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:22.403630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1178ef-8b30-414f-b2a3-d272334a5e5f None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:22.414298 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1178ef-8b30-414f-b2a3-d272334a5e5f None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:22.416432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1178ef-8b30-414f-b2a3-d272334a5e5f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:22.418638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 175/362] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:22 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:22.419223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deb65e-0487-4b5e-ae41-2f44eed69f83 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:22.419787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1178ef-8b30-414f-b2a3-d272334a5e5f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:22.497482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764185b-0578-472f-94f8-77287f8f6667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:22.498647 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764185b-0578-472f-94f8-77287f8f6667 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:22.499147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764185b-0578-472f-94f8-77287f8f6667 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:22.499648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764185b-0578-472f-94f8-77287f8f6667 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:22.521393 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764185b-0578-472f-94f8-77287f8f6667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-0764185b-0578-472f-94f8-77287f8f6667 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:22.531690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:22.533692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:22.535447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 188/363] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:21:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:22.538231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764185b-0578-472f-94f8-77287f8f6667 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:22.621127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1178ef-8b30-414f-b2a3-d272334a5e5f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:22.668764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:22.690306 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c967-3b15-4d1d-ab5d-91af962b286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:22.691551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c967-3b15-4d1d-ab5d-91af962b286a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:22.692073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c967-3b15-4d1d-ab5d-91af962b286a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:22.692643 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c967-3b15-4d1d-ab5d-91af962b286a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:22.711981 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4c967-3b15-4d1d-ab5d-91af962b286a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-40b4c967-3b15-4d1d-ab5d-91af962b286a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:22.721948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:22.723731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:22.724894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 176/364] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:21:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:22.726105 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c967-3b15-4d1d-ab5d-91af962b286a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:22.748390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764185b-0578-472f-94f8-77287f8f6667 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:22.769608 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:22.815169 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf7b50-a223-46ca-a492-5be6dcba5f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:22.816276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7b50-a223-46ca-a492-5be6dcba5f71 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:22.816661 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7b50-a223-46ca-a492-5be6dcba5f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:22.817094 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7b50-a223-46ca-a492-5be6dcba5f71 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:22.819255 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf7b50-a223-46ca-a492-5be6dcba5f71 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:22.821905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf7b50-a223-46ca-a492-5be6dcba5f71 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:22.830575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 189/365] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:22 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:22.830575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf7b50-a223-46ca-a492-5be6dcba5f71 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:22.931983 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c967-3b15-4d1d-ab5d-91af962b286a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:23.004662 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd794ba-0a3c-41c2-841e-300da77175c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:23.005853 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd794ba-0a3c-41c2-841e-300da77175c3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:23.006860 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd794ba-0a3c-41c2-841e-300da77175c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:23.006860 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd794ba-0a3c-41c2-841e-300da77175c3 None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:23.009789 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd794ba-0a3c-41c2-841e-300da77175c3 None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:23.012667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd794ba-0a3c-41c2-841e-300da77175c3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:23.016177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 177/366] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:22 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:23.017623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd794ba-0a3c-41c2-841e-300da77175c3 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:23.022513 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf7b50-a223-46ca-a492-5be6dcba5f71 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:23.091549 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:23.092552 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:23.093081 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:23.093467 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:23.094837 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] RBAC: Adding query filter params (group.id=ad32f18866544f5883f3b3fbf174d876, role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:23.095336 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:23.097797 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:23.108340 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 190/367] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:22 2022] GET /identity/v3/role_assignments?group.id=ad32f18866544f5883f3b3fbf174d876&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:23.110000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:23.120253 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:23.193766 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:23.236970 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd794ba-0a3c-41c2-841e-300da77175c3 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:23.309710 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:23.311034 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:23.311468 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:23.312037 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:23.313559 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:23.314074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:23.316191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:23.331983 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f1ba-2940-4e2b-8611-7c194936f474 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:23.338938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 178/368] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:23.338938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:23.410789 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:23.411778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:23.412189 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:23.412638 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:23.413919 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:23.414370 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:23.416973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:23.433638 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 191/369] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:23.434783 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:23.548240 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92306-b86a-4f2c-acc4-da3a95b74411 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:23.568551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:23.605214 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69261e2-d288-4db4-a964-061fbf10db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:23.606122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69261e2-d288-4db4-a964-061fbf10db99 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:23.606415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69261e2-d288-4db4-a964-061fbf10db99 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:23.606938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69261e2-d288-4db4-a964-061fbf10db99 None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:23.608829 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69261e2-d288-4db4-a964-061fbf10db99 None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:23.611038 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69261e2-d288-4db4-a964-061fbf10db99 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:23.625139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 179/370] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:23 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:23.625139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69261e2-d288-4db4-a964-061fbf10db99 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:23.654360 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3896-a8e9-41fc-8894-479798711f7c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:23.658191 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:23.730068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:23.731162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:23.731654 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:23.732155 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:23.733659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] RBAC: Adding query filter params (group.id=ad32f18866544f5883f3b3fbf174d876, role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:23.734200 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:23.736987 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:23.749256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 192/371] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:23 2022] GET /identity/v3/role_assignments?group.id=ad32f18866544f5883f3b3fbf174d876&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 260 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:23.750573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:23.829071 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69261e2-d288-4db4-a964-061fbf10db99 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:23.910735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da834e-d08a-453f-a1db-9138be4cde0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:23.912430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da834e-d08a-453f-a1db-9138be4cde0c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:23.913421 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da834e-d08a-453f-a1db-9138be4cde0c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:23.914195 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da834e-d08a-453f-a1db-9138be4cde0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:23.995946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:24.007216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb962d35-9d6a-43fd-9d96-3e3c66f33617 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:24.035168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da834e-d08a-453f-a1db-9138be4cde0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:24.038813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da834e-d08a-453f-a1db-9138be4cde0c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:24.100139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762c61-4a5c-49a9-a189-9db34bc27ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:24.101650 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762c61-4a5c-49a9-a189-9db34bc27ec5 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:24.102214 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762c61-4a5c-49a9-a189-9db34bc27ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:24.102714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762c61-4a5c-49a9-a189-9db34bc27ec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:24.187069 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:24.268238 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3762c61-4a5c-49a9-a189-9db34bc27ec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:24.272125 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3762c61-4a5c-49a9-a189-9db34bc27ec5 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:24.276964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 180/372] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:24.292887 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da834e-d08a-453f-a1db-9138be4cde0c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:24.453380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 193/373] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:24.454230 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762c61-4a5c-49a9-a189-9db34bc27ec5 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:24.463782 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:24.501150 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da834e-d08a-453f-a1db-9138be4cde0c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:24.562975 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:24.583380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:24.584522 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:24.585034 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:24.585598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:24.587341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] RBAC: Adding query filter params (group.id=ad32f18866544f5883f3b3fbf174d876, role.id=78e9add141834daea284122464f3f3ed, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:24.587910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:24.590958 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:24.603460 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 181/374] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:24 2022] GET /identity/v3/role_assignments?group.id=ad32f18866544f5883f3b3fbf174d876&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=78e9add141834daea284122464f3f3ed => generated 260 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:24.604966 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:24.624012 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762c61-4a5c-49a9-a189-9db34bc27ec5 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:24.672458 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef1940-b944-4341-b928-4cf57a336515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:24.673180 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1940-b944-4341-b928-4cf57a336515 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:24.673474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1940-b944-4341-b928-4cf57a336515 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:24.673759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1940-b944-4341-b928-4cf57a336515 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:24.675275 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1940-b944-4341-b928-4cf57a336515 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:24.677069 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1940-b944-4341-b928-4cf57a336515 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:24.679407 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 194/375] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:24 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:24.690058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef1940-b944-4341-b928-4cf57a336515 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:24.878280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef1940-b944-4341-b928-4cf57a336515 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:24.912077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56349662-89d9-4d38-a698-a24f612e23b0 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:24.928248 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320131-23b4-4932-acc2-61bbe2437866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:24.928966 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320131-23b4-4932-acc2-61bbe2437866 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:24.929306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320131-23b4-4932-acc2-61bbe2437866 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:24.929556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320131-23b4-4932-acc2-61bbe2437866 None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:24.931510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac320131-23b4-4932-acc2-61bbe2437866 None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:24.933150 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac320131-23b4-4932-acc2-61bbe2437866 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:24.935663 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 195/376] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:24 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:24.946659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320131-23b4-4932-acc2-61bbe2437866 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:24.951298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:24.984603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70540438-0562-40ae-a6eb-5e907a36fcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:24.985765 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540438-0562-40ae-a6eb-5e907a36fcc5 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:24.986274 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540438-0562-40ae-a6eb-5e907a36fcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:24.986905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70540438-0562-40ae-a6eb-5e907a36fcc5 None admin] PATH_INFO: `/v3/projects/29a02beb75e24b5ebbb64e25721c9c99` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:24.991209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70540438-0562-40ae-a6eb-5e907a36fcc5 None admin] RBAC: Authorizing `identity:get_project(project_id=29a02beb75e24b5ebbb64e25721c9c99)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:24.997807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70540438-0562-40ae-a6eb-5e907a36fcc5 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:25.001181 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 182/377] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:24 2022] GET /identity/v3/projects/29a02beb75e24b5ebbb64e25721c9c99 => generated 344 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:25.012032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70540438-0562-40ae-a6eb-5e907a36fcc5 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:25.068310 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:25.171264 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320131-23b4-4932-acc2-61bbe2437866 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:25.231476 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:25.232160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:25.232449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:25.232709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:25.233889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] RBAC: Adding query filter params (group.id=ad32f18866544f5883f3b3fbf174d876, role.id=78e9add141834daea284122464f3f3ed, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:25.234329 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:25.237891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:25.268090 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 196/378] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:24 2022] GET /identity/v3/role_assignments?group.id=ad32f18866544f5883f3b3fbf174d876&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=78e9add141834daea284122464f3f3ed => generated 260 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:25.375169 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70540438-0562-40ae-a6eb-5e907a36fcc5 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:25.471862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c165ec5-b636-45b1-b9cf-e810a0cf67b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:25.473718 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165ec5-b636-45b1-b9cf-e810a0cf67b5 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:25.474648 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165ec5-b636-45b1-b9cf-e810a0cf67b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:25.477056 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165ec5-b636-45b1-b9cf-e810a0cf67b5 None admin] PATH_INFO: `/v3/groups/6a808fdd16744d46a69f870cbe09cef8` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:25.490060 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c165ec5-b636-45b1-b9cf-e810a0cf67b5 None admin] RBAC: Authorizing `identity:get_group(group_id=6a808fdd16744d46a69f870cbe09cef8)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:25.492900 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c165ec5-b636-45b1-b9cf-e810a0cf67b5 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:25.496612 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 183/379] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:25 2022] GET /identity/v3/groups/6a808fdd16744d46a69f870cbe09cef8 => generated 229 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:25.506837 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:25.645859 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:25.733054 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cb64d-8462-4018-bf2a-ddf92527e99c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:25.826380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07057ac-8430-478a-9233-f6a8d959d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:25.833697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07057ac-8430-478a-9233-f6a8d959d1d9 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:25.834776 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07057ac-8430-478a-9233-f6a8d959d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:25.835585 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07057ac-8430-478a-9233-f6a8d959d1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:25.837519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07057ac-8430-478a-9233-f6a8d959d1d9 None admin] RBAC: Adding query filter params (group.id=6a808fdd16744d46a69f870cbe09cef8, role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=29a02beb75e24b5ebbb64e25721c9c99) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:25.838405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07057ac-8430-478a-9233-f6a8d959d1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:25.841529 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07057ac-8430-478a-9233-f6a8d959d1d9 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:25.853474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 197/380] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:25 2022] GET /identity/v3/role_assignments?group.id=6a808fdd16744d46a69f870cbe09cef8&scope.project.id=29a02beb75e24b5ebbb64e25721c9c99&role.id=671de95ce54744059ab540d90d3b40ce => generated 260 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:26.540433 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7ec7-1833-4a02-b6ef-a7344e2352fd None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:26.542028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7ec7-1833-4a02-b6ef-a7344e2352fd None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:26.542801 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7ec7-1833-4a02-b6ef-a7344e2352fd None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:26.546151 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 184/381] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:26.555889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86814368-b3ea-40af-8f56-bafde29b5a5d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:26.557789 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86814368-b3ea-40af-8f56-bafde29b5a5d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:26.558578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86814368-b3ea-40af-8f56-bafde29b5a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:26.602402 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-86814368-b3ea-40af-8f56-bafde29b5a5d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:26.605601 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-86814368-b3ea-40af-8f56-bafde29b5a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:26.740274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 198/382] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:26.783648 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7ec7-1833-4a02-b6ef-a7344e2352fd None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:26.980428 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:27.048499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7ec7-1833-4a02-b6ef-a7344e2352fd None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:27.148737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6fa02-4539-4162-8018-9e4f41c0145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:27.149880 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6fa02-4539-4162-8018-9e4f41c0145a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:27.150727 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6fa02-4539-4162-8018-9e4f41c0145a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:27.150849 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6fa02-4539-4162-8018-9e4f41c0145a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:27.172810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6fa02-4539-4162-8018-9e4f41c0145a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-72a6fa02-4539-4162-8018-9e4f41c0145a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:27.184825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:27.185882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:27.186680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:27.187837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 185/383] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:27.199135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86814368-b3ea-40af-8f56-bafde29b5a5d None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:27.391536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:27.503885 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30222a4-2cab-4cf0-a0db-b1c7e0b82481 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:27.504155 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86814368-b3ea-40af-8f56-bafde29b5a5d None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:27.504967 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30222a4-2cab-4cf0-a0db-b1c7e0b82481 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:27.510060 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30222a4-2cab-4cf0-a0db-b1c7e0b82481 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:27.513834 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 186/384] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:27.551089 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635dadb-d833-4f9b-aa93-7d6a82c27f33 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:27.551783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635dadb-d833-4f9b-aa93-7d6a82c27f33 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:27.552459 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635dadb-d833-4f9b-aa93-7d6a82c27f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:27.587210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:27.588284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:27.588780 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:27.589312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:27.590674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:27.591234 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:27.593968 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:27.611435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 199/385] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:27.622755 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-6635dadb-d833-4f9b-aa93-7d6a82c27f33 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:27.625229 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-6635dadb-d833-4f9b-aa93-7d6a82c27f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:27.637159 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:27.773446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 187/386] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:27.810309 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635dadb-d833-4f9b-aa93-7d6a82c27f33 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:27.901521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:27.946908 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635dadb-d833-4f9b-aa93-7d6a82c27f33 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:27.988341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353349-28e4-4a59-b7d4-b3d0777c4b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:27.989011 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353349-28e4-4a59-b7d4-b3d0777c4b9a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:27.989350 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353349-28e4-4a59-b7d4-b3d0777c4b9a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:27.989633 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353349-28e4-4a59-b7d4-b3d0777c4b9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:28.003613 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8353349-28e4-4a59-b7d4-b3d0777c4b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-a8353349-28e4-4a59-b7d4-b3d0777c4b9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:28.009679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:28.013299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:28.016420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 188/387] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:21:28.026877 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353349-28e4-4a59-b7d4-b3d0777c4b9a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:28.075191 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085aafa-589b-4bbb-a4e4-80d1425738a2 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:28.143834 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353349-28e4-4a59-b7d4-b3d0777c4b9a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:28.172895 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:28.185499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:28.191826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:28.192488 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:28.192775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:28.193269 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:28.194229 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] RBAC: Adding query filter params (name=member) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:28.194640 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:28.196932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:28.208109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 189/388] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:28.214553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:28.241998 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef40c03-2509-4a69-aae0-92ae19571762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:28.243313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef40c03-2509-4a69-aae0-92ae19571762 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:28.243609 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef40c03-2509-4a69-aae0-92ae19571762 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:28.243865 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef40c03-2509-4a69-aae0-92ae19571762 None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:28.250062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef40c03-2509-4a69-aae0-92ae19571762 None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:28.251577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef40c03-2509-4a69-aae0-92ae19571762 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:28.253765 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 200/389] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:27 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 618 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:28.266234 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef40c03-2509-4a69-aae0-92ae19571762 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:28.429152 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5bd9a-8129-44e5-bbba-a21e32fe3494 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:28.495938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9cf2-27e8-444c-a8a7-bdfcc15dc08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:28.497071 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9cf2-27e8-444c-a8a7-bdfcc15dc08c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:28.497631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9cf2-27e8-444c-a8a7-bdfcc15dc08c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:28.498120 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9cf2-27e8-444c-a8a7-bdfcc15dc08c None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:28.501174 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e9cf2-27e8-444c-a8a7-bdfcc15dc08c None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:28.504952 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e9cf2-27e8-444c-a8a7-bdfcc15dc08c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:28.509906 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 190/390] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:28 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:28.520561 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9cf2-27e8-444c-a8a7-bdfcc15dc08c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:28.635637 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef40c03-2509-4a69-aae0-92ae19571762 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:28.661551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:28.731200 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c425-f15a-4e95-84b3-580bd384b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:28.731955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c425-f15a-4e95-84b3-580bd384b616 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:28.732241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c425-f15a-4e95-84b3-580bd384b616 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:28.732523 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c425-f15a-4e95-84b3-580bd384b616 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:28.737400 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c425-f15a-4e95-84b3-580bd384b616 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:28.739061 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c425-f15a-4e95-84b3-580bd384b616 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:28.741351 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 201/391] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:28 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:28.759444 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c425-f15a-4e95-84b3-580bd384b616 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:28.765728 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9cf2-27e8-444c-a8a7-bdfcc15dc08c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:28.840665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de44d7-2b5f-4810-9026-8f9a48703459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:28.841819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de44d7-2b5f-4810-9026-8f9a48703459 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:28.842306 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de44d7-2b5f-4810-9026-8f9a48703459 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:28.842814 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de44d7-2b5f-4810-9026-8f9a48703459 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:28.845286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de44d7-2b5f-4810-9026-8f9a48703459 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:28.848265 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de44d7-2b5f-4810-9026-8f9a48703459 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:28.852666 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 191/392] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:28 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:28.864611 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de44d7-2b5f-4810-9026-8f9a48703459 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:28.894137 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:28.978850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c425-f15a-4e95-84b3-580bd384b616 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:29.048757 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbecd5a-f5eb-4235-8721-493d85700f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:29.050109 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbecd5a-f5eb-4235-8721-493d85700f15 None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.050880 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbecd5a-f5eb-4235-8721-493d85700f15 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.051367 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbecd5a-f5eb-4235-8721-493d85700f15 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/groups/ad32f18866544f5883f3b3fbf174d876/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.055453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbecd5a-f5eb-4235-8721-493d85700f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=23dcd03cd00246bfab8d7c2a33bf3a30, group_id=ad32f18866544f5883f3b3fbf174d876, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:29.060376 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbecd5a-f5eb-4235-8721-493d85700f15 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:29.065732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de44d7-2b5f-4810-9026-8f9a48703459 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:29.082789 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 202/393] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 20:21:28 2022] PUT /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/groups/ad32f18866544f5883f3b3fbf174d876/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:21:29.089097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637cefc-f63e-4d67-b88f-602a442e9015 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.090579 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637cefc-f63e-4d67-b88f-602a442e9015 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.091333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637cefc-f63e-4d67-b88f-602a442e9015 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.101690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 203/394] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:29 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:29.105774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e73ee-e190-473b-a8eb-748c0a4a2be2 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.106193 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e73ee-e190-473b-a8eb-748c0a4a2be2 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.106343 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e73ee-e190-473b-a8eb-748c0a4a2be2 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.108111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 204/395] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:29.111714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7e8f-581f-4957-b6ef-a86fbcc915b4 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.112792 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7e8f-581f-4957-b6ef-a86fbcc915b4 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.114653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7e8f-581f-4957-b6ef-a86fbcc915b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.118301 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:29.132100 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbf99a-f6ae-4536-91ea-0533d698006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:29.133646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbf99a-f6ae-4536-91ea-0533d698006e None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.134129 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbf99a-f6ae-4536-91ea-0533d698006e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.134423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbf99a-f6ae-4536-91ea-0533d698006e None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/groups/ad32f18866544f5883f3b3fbf174d876/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.137224 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbf99a-f6ae-4536-91ea-0533d698006e None admin] RBAC: Authorizing `identity:create_grant(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb, group_id=ad32f18866544f5883f3b3fbf174d876, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:29.138825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbf99a-f6ae-4536-91ea-0533d698006e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:29.157083 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 192/396] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 20:21:28 2022] PUT /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/groups/ad32f18866544f5883f3b3fbf174d876/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:21:29.158362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8f99-3c6c-4404-9ac2-c794b07bbcf5 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.158766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8f99-3c6c-4404-9ac2-c794b07bbcf5 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.159066 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8f99-3c6c-4404-9ac2-c794b07bbcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.163131 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-9e8a7e8f-581f-4957-b6ef-a86fbcc915b4 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:29.166272 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-9e8a7e8f-581f-4957-b6ef-a86fbcc915b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:29.185623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-0b0d8f99-3c6c-4404-9ac2-c794b07bbcf5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:29.187122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-0b0d8f99-3c6c-4404-9ac2-c794b07bbcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:29.282376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 193/397] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:29.306047 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8f99-3c6c-4404-9ac2-c794b07bbcf5 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:29.322236 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 205/398] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:29.370165 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7e8f-581f-4957-b6ef-a86fbcc915b4 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:29.471032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8f99-3c6c-4404-9ac2-c794b07bbcf5 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:29.501225 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:29.504772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:29.544938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34b80d-dea5-4e4f-97b7-6d25cb1fab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:29.546312 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34b80d-dea5-4e4f-97b7-6d25cb1fab90 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.546956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34b80d-dea5-4e4f-97b7-6d25cb1fab90 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.547603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34b80d-dea5-4e4f-97b7-6d25cb1fab90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.565039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34b80d-dea5-4e4f-97b7-6d25cb1fab90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-3e34b80d-dea5-4e4f-97b7-6d25cb1fab90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:29.572557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:29.573575 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:29.574590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:29.577824 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 194/399] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:21:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:29.585466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34b80d-dea5-4e4f-97b7-6d25cb1fab90 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:29.629655 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7e8f-581f-4957-b6ef-a86fbcc915b4 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:29.681298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d241be-35b3-416d-a690-724f0c7195de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:29.683037 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d241be-35b3-416d-a690-724f0c7195de None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.683828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d241be-35b3-416d-a690-724f0c7195de None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.684395 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d241be-35b3-416d-a690-724f0c7195de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.699346 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d241be-35b3-416d-a690-724f0c7195de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-f5d241be-35b3-416d-a690-724f0c7195de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:29.705487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:29.706455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:29.707387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:29.710000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 206/400] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:21:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:29.723117 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d241be-35b3-416d-a690-724f0c7195de None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:29.796062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34b80d-dea5-4e4f-97b7-6d25cb1fab90 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:29.891773 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:29.892804 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:29.893398 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:29.893903 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:29.894877 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:29.895398 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:29.905143 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:29.927008 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 195/401] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:29.934036 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:29.935071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d241be-35b3-416d-a690-724f0c7195de None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:29.965702 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:30.009467 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:30.027798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:30.028555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:30.028842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:30.029131 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:30.030255 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:30.038063 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:30.040051 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:30.074468 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 207/402] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:30.081870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:30.206700 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c30ba-9a1d-41a6-a66c-e3b5a61b5e4f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:30.296987 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e150a28-7745-4aa8-8cb0-e15ce56fdf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:30.298186 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e150a28-7745-4aa8-8cb0-e15ce56fdf53 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:30.298666 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e150a28-7745-4aa8-8cb0-e15ce56fdf53 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:30.299135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e150a28-7745-4aa8-8cb0-e15ce56fdf53 None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:30.302661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e150a28-7745-4aa8-8cb0-e15ce56fdf53 None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:30.306650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e150a28-7745-4aa8-8cb0-e15ce56fdf53 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:30.312824 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 196/403] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:29 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:30.315018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc791d9d-44f1-4c77-9564-05a078a59fd8 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:30.315510 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc791d9d-44f1-4c77-9564-05a078a59fd8 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:30.315988 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc791d9d-44f1-4c77-9564-05a078a59fd8 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:30.318750 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 197/404] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:30.327432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc791d9d-44f1-4c77-9564-05a078a59fd8 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:30.366000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b97ee-6dbc-4b68-b4a7-904d0dca714f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:30.454812 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf8df9-1449-4971-acce-c394a8d9a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:30.456617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf8df9-1449-4971-acce-c394a8d9a6eb None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:30.457524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf8df9-1449-4971-acce-c394a8d9a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:30.458793 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf8df9-1449-4971-acce-c394a8d9a6eb None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:30.462369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf8df9-1449-4971-acce-c394a8d9a6eb None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:30.468038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf8df9-1449-4971-acce-c394a8d9a6eb None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:30.471988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 208/405] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:30 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:30.474782 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3f4e0-26e1-4966-b961-e915863a90a7 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:30.475650 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3f4e0-26e1-4966-b961-e915863a90a7 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:30.476266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3f4e0-26e1-4966-b961-e915863a90a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:30.521446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-99e3f4e0-26e1-4966-b961-e915863a90a7 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:30.525571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-99e3f4e0-26e1-4966-b961-e915863a90a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:30.562332 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc791d9d-44f1-4c77-9564-05a078a59fd8 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:30.576291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:30.614906 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:30.646465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7ab3b-210f-4380-9769-6782270d9635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:30.647878 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ab3b-210f-4380-9769-6782270d9635 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:30.649217 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ab3b-210f-4380-9769-6782270d9635 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:30.650627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ab3b-210f-4380-9769-6782270d9635 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:30.653714 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7ab3b-210f-4380-9769-6782270d9635 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:30.656533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7ab3b-210f-4380-9769-6782270d9635 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:30.661056 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 198/406] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:30 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:30.662924 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7ab3b-210f-4380-9769-6782270d9635 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:30.700715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 209/407] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:30.703194 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3f4e0-26e1-4966-b961-e915863a90a7 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:30.910792 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7ab3b-210f-4380-9769-6782270d9635 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:30.923585 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3f4e0-26e1-4966-b961-e915863a90a7 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:30.985566 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f921-6594-4792-981c-86f90e0c3123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:30.986724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f921-6594-4792-981c-86f90e0c3123 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:30.987338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f921-6594-4792-981c-86f90e0c3123 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:30.987852 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f921-6594-4792-981c-86f90e0c3123 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:30.990418 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988f921-6594-4792-981c-86f90e0c3123 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:30.993839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988f921-6594-4792-981c-86f90e0c3123 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:30.996626 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 199/408] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:30 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:30.998382 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f921-6594-4792-981c-86f90e0c3123 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:31.009007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6c116-be6a-471c-81fc-e05a05410101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:31.010647 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6c116-be6a-471c-81fc-e05a05410101 None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:31.011390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6c116-be6a-471c-81fc-e05a05410101 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:31.012073 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6c116-be6a-471c-81fc-e05a05410101 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/groups/ad32f18866544f5883f3b3fbf174d876/roles/78e9add141834daea284122464f3f3ed` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:31.016080 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6c116-be6a-471c-81fc-e05a05410101 None admin] RBAC: Authorizing `identity:create_grant(project_id=23dcd03cd00246bfab8d7c2a33bf3a30, group_id=ad32f18866544f5883f3b3fbf174d876, role_id=78e9add141834daea284122464f3f3ed)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:31.020221 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6c116-be6a-471c-81fc-e05a05410101 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:31.051228 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 210/409] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 20:21:30 2022] PUT /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30/groups/ad32f18866544f5883f3b3fbf174d876/roles/78e9add141834daea284122464f3f3ed => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:21:31.053086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6c116-be6a-471c-81fc-e05a05410101 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:31.131568 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:31.135686 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:31.289160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6c116-be6a-471c-81fc-e05a05410101 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:31.314211 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f921-6594-4792-981c-86f90e0c3123 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:31.374682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a5bd3-3ae3-4d6d-a9d4-523f32448ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:31.375860 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a5bd3-3ae3-4d6d-a9d4-523f32448ece None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:31.376320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a5bd3-3ae3-4d6d-a9d4-523f32448ece None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:31.376766 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a5bd3-3ae3-4d6d-a9d4-523f32448ece None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/groups/ad32f18866544f5883f3b3fbf174d876/roles/78e9add141834daea284122464f3f3ed` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:31.381900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a5bd3-3ae3-4d6d-a9d4-523f32448ece None admin] RBAC: Authorizing `identity:create_grant(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb, group_id=ad32f18866544f5883f3b3fbf174d876, role_id=78e9add141834daea284122464f3f3ed)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:31.386816 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a5bd3-3ae3-4d6d-a9d4-523f32448ece None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:31.414329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4a05-a7b7-46db-b21c-a70a468e8d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:31.415109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4a05-a7b7-46db-b21c-a70a468e8d94 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:31.415395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4a05-a7b7-46db-b21c-a70a468e8d94 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:31.415671 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4a05-a7b7-46db-b21c-a70a468e8d94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:31.416528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 211/410] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 20:21:31 2022] PUT /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb/groups/ad32f18866544f5883f3b3fbf174d876/roles/78e9add141834daea284122464f3f3ed => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:21:31.436446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4a05-a7b7-46db-b21c-a70a468e8d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-8d0b4a05-a7b7-46db-b21c-a70a468e8d94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:31.443032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:31.444846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:31.446961 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 200/411] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:31.454986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a5bd3-3ae3-4d6d-a9d4-523f32448ece None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:31.690569 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:31.711622 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a5bd3-3ae3-4d6d-a9d4-523f32448ece None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:31.782202 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:31.783229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:31.783687 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:31.784137 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:31.785514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:31.786037 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:31.789404 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:31.808923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 212/412] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:31.816888 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4a05-a7b7-46db-b21c-a70a468e8d94 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:32.092242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4a05-a7b7-46db-b21c-a70a468e8d94 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:32.098157 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:32.198582 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0329dd-b7cb-464a-ab73-cc77eeab044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:32.199706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0329dd-b7cb-464a-ab73-cc77eeab044d None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:32.200191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0329dd-b7cb-464a-ab73-cc77eeab044d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:32.200675 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0329dd-b7cb-464a-ab73-cc77eeab044d None admin] PATH_INFO: `/v3/groups/6a808fdd16744d46a69f870cbe09cef8` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:32.206623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0329dd-b7cb-464a-ab73-cc77eeab044d None admin] RBAC: Authorizing `identity:get_group(group_id=6a808fdd16744d46a69f870cbe09cef8)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:32.209441 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0329dd-b7cb-464a-ab73-cc77eeab044d None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:32.213278 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 201/413] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:31 2022] GET /identity/v3/groups/6a808fdd16744d46a69f870cbe09cef8 => generated 229 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:32.223578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:32.473236 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4b7bc-8d95-4581-b465-ef44fd39de90 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:32.551923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cb7f9-c5ea-4154-8fab-4048ab2fb53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:32.553035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb7f9-c5ea-4154-8fab-4048ab2fb53d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:32.553550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb7f9-c5ea-4154-8fab-4048ab2fb53d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:32.554035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb7f9-c5ea-4154-8fab-4048ab2fb53d None admin] PATH_INFO: `/v3/projects/29a02beb75e24b5ebbb64e25721c9c99` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:32.562624 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cb7f9-c5ea-4154-8fab-4048ab2fb53d None admin] RBAC: Authorizing `identity:get_project(project_id=29a02beb75e24b5ebbb64e25721c9c99)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:32.565343 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cb7f9-c5ea-4154-8fab-4048ab2fb53d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:32.568861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 213/414] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:32 2022] GET /identity/v3/projects/29a02beb75e24b5ebbb64e25721c9c99 => generated 344 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:32.577837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0329dd-b7cb-464a-ab73-cc77eeab044d None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:32.856471 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0329dd-b7cb-464a-ab73-cc77eeab044d None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:32.969513 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898f09-9968-43d3-ab99-36a96d299664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:32.970727 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898f09-9968-43d3-ab99-36a96d299664 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:32.971212 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898f09-9968-43d3-ab99-36a96d299664 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:32.971695 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898f09-9968-43d3-ab99-36a96d299664 None admin] PATH_INFO: `/v3/projects/29a02beb75e24b5ebbb64e25721c9c99/groups/6a808fdd16744d46a69f870cbe09cef8/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:32.979385 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898f09-9968-43d3-ab99-36a96d299664 None admin] RBAC: Authorizing `identity:create_grant(project_id=29a02beb75e24b5ebbb64e25721c9c99, group_id=6a808fdd16744d46a69f870cbe09cef8, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:32.981741 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898f09-9968-43d3-ab99-36a96d299664 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:33.001905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91ca5-2b59-4269-be77-6a557018705a None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:33.002573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91ca5-2b59-4269-be77-6a557018705a None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:33.002573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91ca5-2b59-4269-be77-6a557018705a None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:33.005791 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 214/415] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:33.011244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae19d43-df25-478e-bb0f-2fb05205f00d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:33.011565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae19d43-df25-478e-bb0f-2fb05205f00d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:33.011789 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 202/416] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 20:21:32 2022] PUT /identity/v3/projects/29a02beb75e24b5ebbb64e25721c9c99/groups/6a808fdd16744d46a69f870cbe09cef8/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:21:33.011913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae19d43-df25-478e-bb0f-2fb05205f00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:33.064004 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-eae19d43-df25-478e-bb0f-2fb05205f00d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:33.064004 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-eae19d43-df25-478e-bb0f-2fb05205f00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:33.097059 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:33.103169 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa453-031d-4e26-ba9c-aa67216d2ef2 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:33.103780 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa453-031d-4e26-ba9c-aa67216d2ef2 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:33.104058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa453-031d-4e26-ba9c-aa67216d2ef2 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:33.107208 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 203/417] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:21:33.113170 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160ed68-287d-4127-bf3b-e6a20fe453d0 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:33.113804 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160ed68-287d-4127-bf3b-e6a20fe453d0 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:33.114327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160ed68-287d-4127-bf3b-e6a20fe453d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:33.136772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-5160ed68-287d-4127-bf3b-e6a20fe453d0 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:33.138681 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-5160ed68-287d-4127-bf3b-e6a20fe453d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:33.207802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 215/418] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:33.209521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:33.243967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae19d43-df25-478e-bb0f-2fb05205f00d None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:33.329740 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 204/419] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:33.380112 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160ed68-287d-4127-bf3b-e6a20fe453d0 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:33.559302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae19d43-df25-478e-bb0f-2fb05205f00d None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:33.688565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ff4c-6551-4e00-9bb2-1804e5c8d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:33.689609 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ff4c-6551-4e00-9bb2-1804e5c8d01d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:33.690080 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ff4c-6551-4e00-9bb2-1804e5c8d01d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:33.690571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ff4c-6551-4e00-9bb2-1804e5c8d01d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:33.718576 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1ff4c-6551-4e00-9bb2-1804e5c8d01d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-c4e1ff4c-6551-4e00-9bb2-1804e5c8d01d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:33.724786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:33.725800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:33.727361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:33.728262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160ed68-287d-4127-bf3b-e6a20fe453d0 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:33.731809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 216/420] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:21:33.733239 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ff4c-6551-4e00-9bb2-1804e5c8d01d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:33.766743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:33.808000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719833ce-e66e-4154-bfa6-205d4ee0ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:33.808827 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719833ce-e66e-4154-bfa6-205d4ee0ef6b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:33.809568 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719833ce-e66e-4154-bfa6-205d4ee0ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:33.809942 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719833ce-e66e-4154-bfa6-205d4ee0ef6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:33.840520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719833ce-e66e-4154-bfa6-205d4ee0ef6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-719833ce-e66e-4154-bfa6-205d4ee0ef6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:33.851185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:33.853401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:33.854937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 205/421] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:21:33.865260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719833ce-e66e-4154-bfa6-205d4ee0ef6b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:33.941757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:34.025740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ff4c-6551-4e00-9bb2-1804e5c8d01d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:34.140790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:34.141834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:34.142619 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:34.143109 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:34.144627 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] RBAC: Adding query filter params (name=member) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:34.145186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:34.147830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:34.172000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 217/422] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:34.180280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:34.233298 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719833ce-e66e-4154-bfa6-205d4ee0ef6b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:34.363567 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:34.364595 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:34.365084 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:34.365596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:34.367739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] RBAC: Adding query filter params (name=member) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:34.368080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:34.370403 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:34.393097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 206/423] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:21:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:34.404270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:34.433276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:34.522686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b12af-b7d5-4f88-8b88-830dc09ceabe None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:34.595126 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eed2b-aa14-44fa-9662-1e8b1f030794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:34.596722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eed2b-aa14-44fa-9662-1e8b1f030794 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:34.597496 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eed2b-aa14-44fa-9662-1e8b1f030794 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:34.598228 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eed2b-aa14-44fa-9662-1e8b1f030794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:34.703748 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:34.721035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eed2b-aa14-44fa-9662-1e8b1f030794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:34.722961 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eed2b-aa14-44fa-9662-1e8b1f030794 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:34.781238 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1e4c-89cb-49f2-a8f0-42bfda16da2c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:34.815533 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:34.877062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 218/424] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:34.885712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eed2b-aa14-44fa-9662-1e8b1f030794 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:34.907883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d705ff-27fa-4d89-b5a0-5569853fe659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:34.908558 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d705ff-27fa-4d89-b5a0-5569853fe659 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:34.908843 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d705ff-27fa-4d89-b5a0-5569853fe659 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:34.909133 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d705ff-27fa-4d89-b5a0-5569853fe659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.025147 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d705ff-27fa-4d89-b5a0-5569853fe659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:35.027969 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d705ff-27fa-4d89-b5a0-5569853fe659 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:35.131465 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eed2b-aa14-44fa-9662-1e8b1f030794 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:35.158616 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:35.184994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a665b72-d324-40c8-9832-4784c8ab8dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:35.185687 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665b72-d324-40c8-9832-4784c8ab8dee None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.185970 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665b72-d324-40c8-9832-4784c8ab8dee None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.186244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665b72-d324-40c8-9832-4784c8ab8dee None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.187543 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a665b72-d324-40c8-9832-4784c8ab8dee None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:35.189017 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a665b72-d324-40c8-9832-4784c8ab8dee None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:35.190837 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 219/425] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:34 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:35.192274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f68def-a58e-4596-8cd6-e167949a322f None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.192567 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f68def-a58e-4596-8cd6-e167949a322f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.193000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f68def-a58e-4596-8cd6-e167949a322f None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.194962 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 220/426] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:35.196552 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ffdb-161d-4ea3-8588-723650a91be8 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.196840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ffdb-161d-4ea3-8588-723650a91be8 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.197139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ffdb-161d-4ea3-8588-723650a91be8 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.199793 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 221/427] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:35.202536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a216-803f-40a3-9145-c5e9ba61910b None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.202956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a216-803f-40a3-9145-c5e9ba61910b None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.203393 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a216-803f-40a3-9145-c5e9ba61910b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.215219 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 207/428] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 812 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 20:21:35.221419 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d705ff-27fa-4d89-b5a0-5569853fe659 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:35.232359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-8541a216-803f-40a3-9145-c5e9ba61910b None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:35.233655 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-8541a216-803f-40a3-9145-c5e9ba61910b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:35.287601 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:35.363439 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 222/429] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:35.367212 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b69d3-fada-4667-b687-01fe13288ab4 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.367497 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d705ff-27fa-4d89-b5a0-5569853fe659 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:35.368804 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b69d3-fada-4667-b687-01fe13288ab4 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.369791 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b69d3-fada-4667-b687-01fe13288ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.402178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-681b69d3-fada-4667-b687-01fe13288ab4 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:35.403454 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-681b69d3-fada-4667-b687-01fe13288ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:35.418617 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be2510-6e9b-4878-a0b8-c2d4e6609b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:35.419386 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2510-6e9b-4878-a0b8-c2d4e6609b8a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.419553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2510-6e9b-4878-a0b8-c2d4e6609b8a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.419844 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be2510-6e9b-4878-a0b8-c2d4e6609b8a None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.421268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be2510-6e9b-4878-a0b8-c2d4e6609b8a None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:35.422763 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be2510-6e9b-4878-a0b8-c2d4e6609b8a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:35.424507 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 208/430] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:35 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:35.427475 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be2510-6e9b-4878-a0b8-c2d4e6609b8a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:35.486123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 223/431] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:35.487024 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b69d3-fada-4667-b687-01fe13288ab4 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:35.540005 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:35.635751 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be2510-6e9b-4878-a0b8-c2d4e6609b8a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:35.679056 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:35.685017 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b69d3-fada-4667-b687-01fe13288ab4 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:35.688764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750ed3b-f32a-443d-8303-1e0b095c8173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:35.689672 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750ed3b-f32a-443d-8303-1e0b095c8173 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.690157 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750ed3b-f32a-443d-8303-1e0b095c8173 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.690661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750ed3b-f32a-443d-8303-1e0b095c8173 None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.692213 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750ed3b-f32a-443d-8303-1e0b095c8173 None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:35.693974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750ed3b-f32a-443d-8303-1e0b095c8173 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:35.704854 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 209/432] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:35 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:35.704854 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750ed3b-f32a-443d-8303-1e0b095c8173 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:35.747444 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c714-a12b-4eb3-b912-364e1c7e5a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:35.748379 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c714-a12b-4eb3-b912-364e1c7e5a7b None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.748721 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c714-a12b-4eb3-b912-364e1c7e5a7b None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.748979 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c714-a12b-4eb3-b912-364e1c7e5a7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.765293 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5c714-a12b-4eb3-b912-364e1c7e5a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-ead5c714-a12b-4eb3-b912-364e1c7e5a7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:35.777183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:35.779020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 224/433] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:21:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:35.781595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c714-a12b-4eb3-b912-364e1c7e5a7b None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:35.902823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750ed3b-f32a-443d-8303-1e0b095c8173 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:35.944315 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:35.966120 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c714-a12b-4eb3-b912-364e1c7e5a7b None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:35.989434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:35.990949 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:35.991177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:35.991464 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:35.994269 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] RBAC: Adding query filter params (group.id=ad32f18866544f5883f3b3fbf174d876, role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:35.994792 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:35.997291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:36.009427 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 210/434] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:35 2022] GET /identity/v3/role_assignments?group.id=ad32f18866544f5883f3b3fbf174d876&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 611 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:36.011105 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:36.046268 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25f3ad-b852-4795-9c29-022a530673a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:36.047986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25f3ad-b852-4795-9c29-022a530673a2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:36.048801 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25f3ad-b852-4795-9c29-022a530673a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:36.049579 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25f3ad-b852-4795-9c29-022a530673a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:36.078507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25f3ad-b852-4795-9c29-022a530673a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-fe25f3ad-b852-4795-9c29-022a530673a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:36.088419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:36.090759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 20:21:36.092642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:36.101218 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 225/435] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:21:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:36.101218 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25f3ad-b852-4795-9c29-022a530673a2 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:36.142690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:36.266664 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28cb66-797f-493e-a763-a743a6df93ed None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:36.352767 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25f3ad-b852-4795-9c29-022a530673a2 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:36.363456 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31537-1b62-4bea-a19f-5e72e6709078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:36.364513 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31537-1b62-4bea-a19f-5e72e6709078 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:36.364980 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31537-1b62-4bea-a19f-5e72e6709078 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:36.365489 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31537-1b62-4bea-a19f-5e72e6709078 None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:36.368843 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff31537-1b62-4bea-a19f-5e72e6709078 None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:36.373348 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff31537-1b62-4bea-a19f-5e72e6709078 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:36.376677 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 211/436] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:36 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:36.377879 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31537-1b62-4bea-a19f-5e72e6709078 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:36.443830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:36.447333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:36.448722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:36.449474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:36.451472 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:36.452639 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:36.454716 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:36.468722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 226/437] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:36.471019 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:36.494834 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:36.593899 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31537-1b62-4bea-a19f-5e72e6709078 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:36.636512 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:36.658015 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:36.658701 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:36.658987 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:36.659270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:36.660026 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:36.660330 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:36.661833 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:36.675003 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965127f3-4122-4d30-aca2-100fbe79a316 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:36.679181 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 212/438] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:36.679867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:36.726196 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:36.727855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:36.728053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:36.728375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:36.729463 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] RBAC: Adding query filter params (group.id=ad32f18866544f5883f3b3fbf174d876, role.id=5ec05e28e64d4e4b9db1be2d37af117a, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:36.729912 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:36.732296 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:36.740563 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 227/439] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:36 2022] GET /identity/v3/role_assignments?group.id=ad32f18866544f5883f3b3fbf174d876&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=5ec05e28e64d4e4b9db1be2d37af117a => generated 611 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:36.741483 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:36.889571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067303a-7057-4f23-b3a3-8ec06e6a0164 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:36.896823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1c10a-1780-462c-8214-5bb0bbda6095 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:36.927368 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:36.938672 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4856c2f-4985-4264-bf99-d1687c537239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:36.939121 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856c2f-4985-4264-bf99-d1687c537239 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:36.939346 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856c2f-4985-4264-bf99-d1687c537239 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:36.939609 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856c2f-4985-4264-bf99-d1687c537239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:36.969714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:36.983735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6b438-e9be-4918-b28c-d3e8dca07eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:36.984845 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b438-e9be-4918-b28c-d3e8dca07eb6 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:36.985393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b438-e9be-4918-b28c-d3e8dca07eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:36.985891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b438-e9be-4918-b28c-d3e8dca07eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:37.047433 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4856c2f-4985-4264-bf99-d1687c537239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:37.050718 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4856c2f-4985-4264-bf99-d1687c537239 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:37.150405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6b438-e9be-4918-b28c-d3e8dca07eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:37.153969 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6b438-e9be-4918-b28c-d3e8dca07eb6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:37.221722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 228/440] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:37.233216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4856c2f-4985-4264-bf99-d1687c537239 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:37.317051 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:37.393307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 213/441] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:37.395651 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96067242-59f6-4d7e-90df-739d2c7010d8 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:37.396175 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96067242-59f6-4d7e-90df-739d2c7010d8 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:37.396658 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96067242-59f6-4d7e-90df-739d2c7010d8 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:37.401508 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 214/442] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:37.402840 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96067242-59f6-4d7e-90df-739d2c7010d8 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:37.418153 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4856c2f-4985-4264-bf99-d1687c537239 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:37.431123 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:37.470955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a971f3-5e40-4093-9a15-f25cbf9b2ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:37.472082 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a971f3-5e40-4093-9a15-f25cbf9b2ca9 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:37.472581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a971f3-5e40-4093-9a15-f25cbf9b2ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:37.473052 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a971f3-5e40-4093-9a15-f25cbf9b2ca9 None admin] PATH_INFO: `/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:37.475366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a971f3-5e40-4093-9a15-f25cbf9b2ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=36f2e8bb7d24434eba5f04efcdc9c3eb)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:37.478840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a971f3-5e40-4093-9a15-f25cbf9b2ca9 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:37.482310 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 229/443] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:37 2022] GET /identity/v3/projects/36f2e8bb7d24434eba5f04efcdc9c3eb => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:37.484583 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e08122-7dbe-4f2d-9463-3f054aaddf0b None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:37.485072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e08122-7dbe-4f2d-9463-3f054aaddf0b None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:37.485584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e08122-7dbe-4f2d-9463-3f054aaddf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:37.518338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-28e08122-7dbe-4f2d-9463-3f054aaddf0b None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:37.520535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-28e08122-7dbe-4f2d-9463-3f054aaddf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:37.597777 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96067242-59f6-4d7e-90df-739d2c7010d8 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:37.654474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 230/444] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:37.660669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e08122-7dbe-4f2d-9463-3f054aaddf0b None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:37.670387 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef141925-dff2-46b6-beb5-b4e528f9e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:37.671519 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef141925-dff2-46b6-beb5-b4e528f9e9eb None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:37.672094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef141925-dff2-46b6-beb5-b4e528f9e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:37.672599 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef141925-dff2-46b6-beb5-b4e528f9e9eb None admin] PATH_INFO: `/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:37.674919 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef141925-dff2-46b6-beb5-b4e528f9e9eb None admin] RBAC: Authorizing `identity:get_project(project_id=23dcd03cd00246bfab8d7c2a33bf3a30)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:37.678086 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef141925-dff2-46b6-beb5-b4e528f9e9eb None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:37.689883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 215/445] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:37 2022] GET /identity/v3/projects/23dcd03cd00246bfab8d7c2a33bf3a30 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:37.689883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef141925-dff2-46b6-beb5-b4e528f9e9eb None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:37.742537 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:37.813715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e08122-7dbe-4f2d-9463-3f054aaddf0b None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:37.840985 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:37.875754 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84224165-bf90-4afc-b4c3-cc78cf079c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:37.876867 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224165-bf90-4afc-b4c3-cc78cf079c73 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:37.877408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224165-bf90-4afc-b4c3-cc78cf079c73 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:37.877910 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224165-bf90-4afc-b4c3-cc78cf079c73 None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:37.880002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84224165-bf90-4afc-b4c3-cc78cf079c73 None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:37.881488 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef141925-dff2-46b6-beb5-b4e528f9e9eb None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:37.883194 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84224165-bf90-4afc-b4c3-cc78cf079c73 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:37.886779 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 231/446] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:37 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:37.888025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84224165-bf90-4afc-b4c3-cc78cf079c73 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:37.949974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f8ac-0a1a-41f4-bf49-6da880a629ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:37.951026 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f8ac-0a1a-41f4-bf49-6da880a629ec None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:37.951505 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f8ac-0a1a-41f4-bf49-6da880a629ec None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:37.951987 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f8ac-0a1a-41f4-bf49-6da880a629ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:37.972917 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38f8ac-0a1a-41f4-bf49-6da880a629ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-6e38f8ac-0a1a-41f4-bf49-6da880a629ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:37.983030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:37.984957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 216/447] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:21:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:37.986646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f8ac-0a1a-41f4-bf49-6da880a629ec None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:38.071805 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84224165-bf90-4afc-b4c3-cc78cf079c73 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:38.098532 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:38.141959 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851abe1e-8e1e-4e1a-8d8f-c1f8a32f46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:38.142963 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851abe1e-8e1e-4e1a-8d8f-c1f8a32f46de None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:38.143512 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851abe1e-8e1e-4e1a-8d8f-c1f8a32f46de None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:38.143905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851abe1e-8e1e-4e1a-8d8f-c1f8a32f46de None admin] PATH_INFO: `/v3/groups/ad32f18866544f5883f3b3fbf174d876` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:38.145856 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851abe1e-8e1e-4e1a-8d8f-c1f8a32f46de None admin] RBAC: Authorizing `identity:get_group(group_id=ad32f18866544f5883f3b3fbf174d876)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:38.148505 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851abe1e-8e1e-4e1a-8d8f-c1f8a32f46de None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:38.151571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 232/448] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:37 2022] GET /identity/v3/groups/ad32f18866544f5883f3b3fbf174d876 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:38.152715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851abe1e-8e1e-4e1a-8d8f-c1f8a32f46de None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:38.188622 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f8ac-0a1a-41f4-bf49-6da880a629ec None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:38.252519 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:38.253187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:38.253552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:38.253894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:38.254971 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] RBAC: Adding query filter params (group.id=ad32f18866544f5883f3b3fbf174d876, role.id=78e9add141834daea284122464f3f3ed, scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:38.255441 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:38.258193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:38.266686 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 217/449] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:37 2022] GET /identity/v3/role_assignments?group.id=ad32f18866544f5883f3b3fbf174d876&scope.project.id=36f2e8bb7d24434eba5f04efcdc9c3eb&role.id=78e9add141834daea284122464f3f3ed => generated 611 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:38.267897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:38.283923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:38.366463 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851abe1e-8e1e-4e1a-8d8f-c1f8a32f46de None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:38.441382 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:38.441896 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87985e0-1af3-4aff-95a7-1788e9b12f88 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:38.442588 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:38.442588 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:38.442846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:38.443518 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:38.443810 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:38.445740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:38.467265 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 233/450] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:38.469720 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:38.518208 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:38.518752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:38.519130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:38.519414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:38.520231 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] RBAC: Adding query filter params (group.id=ad32f18866544f5883f3b3fbf174d876, role.id=78e9add141834daea284122464f3f3ed, scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:38.520546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:38.522092 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:38.530788 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 218/451] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:38 2022] GET /identity/v3/role_assignments?group.id=ad32f18866544f5883f3b3fbf174d876&scope.project.id=23dcd03cd00246bfab8d7c2a33bf3a30&role.id=78e9add141834daea284122464f3f3ed => generated 611 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:38.548992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:38.649868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c3bf2-315b-4fb1-bb26-866a5c0e7c31 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:38.695945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb10131-f504-4a36-94d9-53463103349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:38.696749 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb10131-f504-4a36-94d9-53463103349f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:38.697040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb10131-f504-4a36-94d9-53463103349f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:38.697358 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb10131-f504-4a36-94d9-53463103349f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:38.817881 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb10131-f504-4a36-94d9-53463103349f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:38.821096 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb10131-f504-4a36-94d9-53463103349f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:38.879270 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:38.993376 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 234/452] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:39.001453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:39.115810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:39.176737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb122df-84fc-41b8-86ff-2a7b90c0d53c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:39.253832 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e9e09-d0bb-48e2-bc49-b021b1093e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:39.255010 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9e09-d0bb-48e2-bc49-b021b1093e4e None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:39.255534 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9e09-d0bb-48e2-bc49-b021b1093e4e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:39.256036 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9e09-d0bb-48e2-bc49-b021b1093e4e None admin] PATH_INFO: `/v3/projects/29a02beb75e24b5ebbb64e25721c9c99` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:39.259162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e9e09-d0bb-48e2-bc49-b021b1093e4e None admin] RBAC: Authorizing `identity:get_project(project_id=29a02beb75e24b5ebbb64e25721c9c99)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:39.262079 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e9e09-d0bb-48e2-bc49-b021b1093e4e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:39.265541 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 219/453] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 20:21:38 2022] GET /identity/v3/projects/29a02beb75e24b5ebbb64e25721c9c99 => generated 344 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:39.276061 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb10131-f504-4a36-94d9-53463103349f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:39.463109 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb10131-f504-4a36-94d9-53463103349f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:39.524144 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca7a23-9dcf-4625-9ae4-6946496e0f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:39.524947 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7a23-9dcf-4625-9ae4-6946496e0f79 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:39.525362 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7a23-9dcf-4625-9ae4-6946496e0f79 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:39.525745 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7a23-9dcf-4625-9ae4-6946496e0f79 None admin] PATH_INFO: `/v3/groups/6a808fdd16744d46a69f870cbe09cef8` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:39.527659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca7a23-9dcf-4625-9ae4-6946496e0f79 None admin] RBAC: Authorizing `identity:get_group(group_id=6a808fdd16744d46a69f870cbe09cef8)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:39.529832 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca7a23-9dcf-4625-9ae4-6946496e0f79 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:39.532365 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 235/454] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 20:21:39 2022] GET /identity/v3/groups/6a808fdd16744d46a69f870cbe09cef8 => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:39.543831 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e9e09-d0bb-48e2-bc49-b021b1093e4e None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:39.702324 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e9e09-d0bb-48e2-bc49-b021b1093e4e None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:39.753628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbaef6-4a24-4b83-ac0e-26230985ecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:39.754348 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbaef6-4a24-4b83-ac0e-26230985ecf4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:39.754742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbaef6-4a24-4b83-ac0e-26230985ecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:39.755195 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbaef6-4a24-4b83-ac0e-26230985ecf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:39.756255 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbaef6-4a24-4b83-ac0e-26230985ecf4 None admin] RBAC: Adding query filter params (group.id=6a808fdd16744d46a69f870cbe09cef8, role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=29a02beb75e24b5ebbb64e25721c9c99) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:39.756604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbaef6-4a24-4b83-ac0e-26230985ecf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:39.759176 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbaef6-4a24-4b83-ac0e-26230985ecf4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:39.764221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:39.769637 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 220/455] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 20:21:39 2022] GET /identity/v3/role_assignments?group.id=6a808fdd16744d46a69f870cbe09cef8&scope.project.id=29a02beb75e24b5ebbb64e25721c9c99&role.id=671de95ce54744059ab540d90d3b40ce => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:43.495829 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69ff5d-68d9-4129-bd0b-a7ecb5d07a75 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:43.496701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69ff5d-68d9-4129-bd0b-a7ecb5d07a75 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:43.497160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69ff5d-68d9-4129-bd0b-a7ecb5d07a75 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:43.499572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 236/456] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:43.508745 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99359f-d708-4abd-96ea-8e136adac47b None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:43.509671 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99359f-d708-4abd-96ea-8e136adac47b None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:43.510113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99359f-d708-4abd-96ea-8e136adac47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:43.542962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-fe99359f-d708-4abd-96ea-8e136adac47b None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:43.545467 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-fe99359f-d708-4abd-96ea-8e136adac47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:43.648559 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 221/457] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:43.676626 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69ff5d-68d9-4129-bd0b-a7ecb5d07a75 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:43.693196 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:43.891199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69ff5d-68d9-4129-bd0b-a7ecb5d07a75 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:43.940390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203600c8-275b-4ff3-9b4f-4a5868cb88a7 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:43.941432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203600c8-275b-4ff3-9b4f-4a5868cb88a7 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:43.942247 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203600c8-275b-4ff3-9b4f-4a5868cb88a7 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:43.952505 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 222/458] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:21:43.955570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb6d1c-1b43-4dc9-817d-fa5bb02fc27f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:43.956521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb6d1c-1b43-4dc9-817d-fa5bb02fc27f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:43.957439 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb6d1c-1b43-4dc9-817d-fa5bb02fc27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:43.965243 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:43.966358 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:43.966853 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:43.967370 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:43.996759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:43.999762 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:44.000813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-e5fb6d1c-1b43-4dc9-817d-fa5bb02fc27f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:44.003851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-e5fb6d1c-1b43-4dc9-817d-fa5bb02fc27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:44.031826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:44.033534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:44.035201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:44.035201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:44.035201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:44.035201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:44.035201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 237/459] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:44.045922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:44.178104 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:44.191679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 223/460] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:44.194345 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96798-7ea9-42d0-93b3-d3a97aaa4f0d None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:44.195808 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96798-7ea9-42d0-93b3-d3a97aaa4f0d None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:44.196442 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96798-7ea9-42d0-93b3-d3a97aaa4f0d None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:44.198926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 224/461] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:44.207870 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4422-ebbf-480b-9d8b-374022c394be None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:44.208667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4422-ebbf-480b-9d8b-374022c394be None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:44.209370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4422-ebbf-480b-9d8b-374022c394be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:44.246819 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fa006-b282-455d-b4c3-a2a591370c47 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:44.247673 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-d3ee4422-ebbf-480b-9d8b-374022c394be None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:44.250465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-d3ee4422-ebbf-480b-9d8b-374022c394be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:44.305975 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:44.306803 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:44.307102 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:44.307468 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:44.308269 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:44.308782 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:44.311134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:44.338301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 238/462] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:44.339630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:44.365325 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:44.391273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 225/463] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:44.393546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c9451-1238-4678-b35d-ef4552a4c5ab None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:44.394062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c9451-1238-4678-b35d-ef4552a4c5ab None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:44.394869 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c9451-1238-4678-b35d-ef4552a4c5ab None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:44.397375 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 226/464] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:44.399135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c9451-1238-4678-b35d-ef4552a4c5ab None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:44.508953 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c5aae-1fcb-4169-aee8-19d6216e501e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:44.551828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:44.572562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360cd1-ba23-412f-a429-e14ec82df2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:44.573439 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360cd1-ba23-412f-a429-e14ec82df2c7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:44.573839 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360cd1-ba23-412f-a429-e14ec82df2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:44.574279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360cd1-ba23-412f-a429-e14ec82df2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:44.575644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c9451-1238-4678-b35d-ef4552a4c5ab None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:44.591055 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77360cd1-ba23-412f-a429-e14ec82df2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:44.592603 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77360cd1-ba23-412f-a429-e14ec82df2c7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-77360cd1-ba23-412f-a429-e14ec82df2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:44.617390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:44.619107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:44.620810 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:44.620810 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:44.620810 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:44.620810 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:44.620810 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 239/465] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:44.621669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48445f-2574-403d-85cb-1f84846b736c None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:44.622136 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48445f-2574-403d-85cb-1f84846b736c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:44.623269 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48445f-2574-403d-85cb-1f84846b736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:44.634945 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0842e4-c6a2-4353-8535-ecc7f1146b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:44.635697 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0842e4-c6a2-4353-8535-ecc7f1146b40 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:44.635977 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0842e4-c6a2-4353-8535-ecc7f1146b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:44.636253 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0842e4-c6a2-4353-8535-ecc7f1146b40 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:44.637323 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0842e4-c6a2-4353-8535-ecc7f1146b40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:44.639242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0842e4-c6a2-4353-8535-ecc7f1146b40 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:44.647543 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-6c48445f-2574-403d-85cb-1f84846b736c None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:44.650010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-6c48445f-2574-403d-85cb-1f84846b736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:44.668660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 227/466] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:21:44 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:21:44.670229 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0842e4-c6a2-4353-8535-ecc7f1146b40 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:44.774918 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 240/467] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:44.775759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48445f-2574-403d-85cb-1f84846b736c None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:44.791992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:44.914952 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0842e4-c6a2-4353-8535-ecc7f1146b40 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:44.969166 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:44.969807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:44.970313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:44.970800 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:44.994467 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:44.997407 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:44.999124 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48445f-2574-403d-85cb-1f84846b736c None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:45.005408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:45.029778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:45.031435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:45.033067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:45.033067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:45.033067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:45.033067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:45.033067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 228/468] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:45.034418 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:45.082057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:45.082533 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:45.082762 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:45.083011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:45.083752 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:45.084065 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:45.086203 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:45.112970 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 241/469] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:45.115277 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:45.209848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:45.217431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1851bb-1900-41e7-bde3-f3585c1be78f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:45.278564 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:45.279916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:45.280377 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:45.280898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:45.302353 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf0a6c-2040-4bff-93ab-9e9a4d75140e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:45.306849 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:45.310043 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:45.334207 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:45.336221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:45.338270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:45.338270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:45.338270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:45.338270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:45.338270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 229/470] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:45.338270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:45.365568 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:45.367239 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:45.367725 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:45.368224 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:45.369560 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:45.370102 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:45.372756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:45.398889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 242/471] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:45.400416 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:45.450618 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:45.534136 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7260-f7a4-415c-b779-4110df3adca3 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:45.596707 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae1d18-1572-49ce-9f29-7e19674ca2da None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:45.600037 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a76834-8139-4d8e-a86f-8ff5d9cf65fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:45.601060 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a76834-8139-4d8e-a86f-8ff5d9cf65fd None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:45.601564 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a76834-8139-4d8e-a86f-8ff5d9cf65fd None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:45.604019 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a76834-8139-4d8e-a86f-8ff5d9cf65fd None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:45.605398 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a76834-8139-4d8e-a86f-8ff5d9cf65fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:45.606752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a76834-8139-4d8e-a86f-8ff5d9cf65fd None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:45.645163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 230/472] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:21:45 2022] POST /identity/v3/users => generated 246 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:21:45.645163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a76834-8139-4d8e-a86f-8ff5d9cf65fd None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:45.660860 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:45.673653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:45.674804 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:45.675562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:45.676497 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:45.677229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:45.677683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:45.681042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:45.716434 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 243/473] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:45.723171 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:45.829292 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a76834-8139-4d8e-a86f-8ff5d9cf65fd None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:45.906466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1104078-391f-4168-a0e7-f43530964392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:45.907151 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104078-391f-4168-a0e7-f43530964392 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:45.907635 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104078-391f-4168-a0e7-f43530964392 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:45.908117 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1104078-391f-4168-a0e7-f43530964392 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:45.909387 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1104078-391f-4168-a0e7-f43530964392 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:45.912050 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1104078-391f-4168-a0e7-f43530964392 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:45.924170 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:45.966680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 231/474] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:21:45 2022] POST /identity/v3/users => generated 249 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:21:45.972757 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e21446-4eb2-4403-b733-1b33d87040ac None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:46.068064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d82c5-69e3-472e-acc6-cb7398f117a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:46.068918 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d82c5-69e3-472e-acc6-cb7398f117a2 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:46.069205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d82c5-69e3-472e-acc6-cb7398f117a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:46.069492 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d82c5-69e3-472e-acc6-cb7398f117a2 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:46.070742 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d82c5-69e3-472e-acc6-cb7398f117a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:46.072467 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d82c5-69e3-472e-acc6-cb7398f117a2 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:46.109780 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 244/475] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:21:45 2022] POST /identity/v3/users => generated 248 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:21:48.590129 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d78da-888d-44bd-8094-e642eacf5bdb None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:48.590981 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d78da-888d-44bd-8094-e642eacf5bdb None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:48.591218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d78da-888d-44bd-8094-e642eacf5bdb None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:48.594294 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 232/476] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:48.604305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53104c-0a6a-4182-b61e-e658af80f445 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:48.605140 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53104c-0a6a-4182-b61e-e658af80f445 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:48.605386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53104c-0a6a-4182-b61e-e658af80f445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:48.639282 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-3d53104c-0a6a-4182-b61e-e658af80f445 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:48.641618 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-3d53104c-0a6a-4182-b61e-e658af80f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:48.794182 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 245/477] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:48.828596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d78da-888d-44bd-8094-e642eacf5bdb None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:48.956423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:49.043263 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d78da-888d-44bd-8094-e642eacf5bdb None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:49.099409 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ed0d4-a684-420d-9a5a-f7688ba7b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:49.100338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed0d4-a684-420d-9a5a-f7688ba7b34b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.100620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed0d4-a684-420d-9a5a-f7688ba7b34b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.100922 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed0d4-a684-420d-9a5a-f7688ba7b34b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.118131 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ed0d4-a684-420d-9a5a-f7688ba7b34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-117ed0d4-a684-420d-9a5a-f7688ba7b34b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:49.125243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:49.127549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:49.130388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 233/478] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:21:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:49.139540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53104c-0a6a-4182-b61e-e658af80f445 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:49.212104 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694366f7-8ae8-4861-8a1c-fea053f175a8 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.212524 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694366f7-8ae8-4861-8a1c-fea053f175a8 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.212908 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694366f7-8ae8-4861-8a1c-fea053f175a8 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.215454 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 234/479] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:21:49.224299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487efd5-76df-4ea8-ad10-f8633fd959fc None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.224800 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487efd5-76df-4ea8-ad10-f8633fd959fc None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.225370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487efd5-76df-4ea8-ad10-f8633fd959fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.269419 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-2487efd5-76df-4ea8-ad10-f8633fd959fc None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:49.271640 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-2487efd5-76df-4ea8-ad10-f8633fd959fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:49.277994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:49.357378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53104c-0a6a-4182-b61e-e658af80f445 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:49.409457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 235/480] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:49.431405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:49.432651 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.433237 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.433586 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487efd5-76df-4ea8-ad10-f8633fd959fc None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:49.433739 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.435206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:49.435774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:49.438637 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:49.457234 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 246/481] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:49.468298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:49.521206 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:49.583387 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487efd5-76df-4ea8-ad10-f8633fd959fc None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:49.630908 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14fbf9-0e12-430c-b7e6-b09f729fd47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:49.633139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14fbf9-0e12-430c-b7e6-b09f729fd47a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.633890 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14fbf9-0e12-430c-b7e6-b09f729fd47a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.634471 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14fbf9-0e12-430c-b7e6-b09f729fd47a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.647437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14fbf9-0e12-430c-b7e6-b09f729fd47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-9f14fbf9-0e12-430c-b7e6-b09f729fd47a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:49.653453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:49.654390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:49.655177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:49.657690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 236/482] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:21:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:49.661076 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a73fd8-5185-417e-a462-04385b2a492a None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.661888 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a73fd8-5185-417e-a462-04385b2a492a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.662368 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a73fd8-5185-417e-a462-04385b2a492a None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.665953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 237/483] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:49.671151 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a73fd8-5185-417e-a462-04385b2a492a None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:49.699592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe89187-6e79-4c47-8b79-fc48af85ef0c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:49.766850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:49.776298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc73f1-fce0-4b21-a060-d902e3856ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:49.776975 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc73f1-fce0-4b21-a060-d902e3856ecb None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.777275 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc73f1-fce0-4b21-a060-d902e3856ecb None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.777557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc73f1-fce0-4b21-a060-d902e3856ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.803555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc73f1-fce0-4b21-a060-d902e3856ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:49.806882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc73f1-fce0-4b21-a060-d902e3856ecb None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-73bc73f1-fce0-4b21-a060-d902e3856ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:49.834675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:49.837850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:49.847477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:49.847477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:49.847477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:49.847477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:49.847477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 247/484] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:49.847477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29a7b1-5e58-45dc-a498-f4701dc8f39d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.847477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29a7b1-5e58-45dc-a498-f4701dc8f39d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.847477 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29a7b1-5e58-45dc-a498-f4701dc8f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.874000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-8e29a7b1-5e58-45dc-a498-f4701dc8f39d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:49.875906 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-8e29a7b1-5e58-45dc-a498-f4701dc8f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:49.893912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a73fd8-5185-417e-a462-04385b2a492a None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:49.920119 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:49.957116 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:49.958174 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:49.958647 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:49.959131 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:49.960482 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:49.961556 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:49.964182 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:49.977943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 238/485] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:49.979416 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:50.002876 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 248/486] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:50.004991 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bf4a7-dec8-4582-952c-1828b5dde20c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:50.005484 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bf4a7-dec8-4582-952c-1828b5dde20c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:50.005930 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bf4a7-dec8-4582-952c-1828b5dde20c None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:50.008942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 249/487] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:50.010307 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bf4a7-dec8-4582-952c-1828b5dde20c None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:50.161098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc143f-9320-4ea5-aceb-8512e62efaf2 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:50.190681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bf4a7-dec8-4582-952c-1828b5dde20c None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:50.210253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:50.231240 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab601b-0549-4179-b1c5-2dff7294b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:50.232315 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab601b-0549-4179-b1c5-2dff7294b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:50.232783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab601b-0549-4179-b1c5-2dff7294b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:50.233323 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab601b-0549-4179-b1c5-2dff7294b0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:50.234624 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab601b-0549-4179-b1c5-2dff7294b0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:50.235152 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab601b-0549-4179-b1c5-2dff7294b0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:50.237825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab601b-0549-4179-b1c5-2dff7294b0f3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:50.246054 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:50.246862 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:50.247267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:50.247667 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:50.262939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 239/488] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:50.263192 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:50.265146 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46ff5-6786-4220-8815-cd3f5bdd3810 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:50.265607 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46ff5-6786-4220-8815-cd3f5bdd3810 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:50.265790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:50.266078 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46ff5-6786-4220-8815-cd3f5bdd3810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:50.285734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:50.287633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:50.289948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:50.289948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:50.289948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:50.289948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:50.289948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 250/489] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:50.291003 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:50.301873 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-29f46ff5-6786-4220-8815-cd3f5bdd3810 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:50.303354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-29f46ff5-6786-4220-8815-cd3f5bdd3810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:50.346825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:50.401659 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 240/490] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:50.403153 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46ff5-6786-4220-8815-cd3f5bdd3810 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:50.432324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84bd55-3e98-4f8e-b7b6-ac3fb87303e8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:50.498461 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cec30-e3c1-45a9-9589-d05857625f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:50.499571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cec30-e3c1-45a9-9589-d05857625f83 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:50.500089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cec30-e3c1-45a9-9589-d05857625f83 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:50.500579 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cec30-e3c1-45a9-9589-d05857625f83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:50.521839 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cec30-e3c1-45a9-9589-d05857625f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-1b4cec30-e3c1-45a9-9589-d05857625f83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:50.534135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:50.536025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:50.537684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 251/491] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:21:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:50.539173 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cec30-e3c1-45a9-9589-d05857625f83 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:50.590759 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46ff5-6786-4220-8815-cd3f5bdd3810 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:50.594651 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:50.642448 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:50.643437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:50.643940 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:50.644428 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:50.658586 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:50.660090 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:21:50.677058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:50.678851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 241/492] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:50.681401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:50.719096 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cec30-e3c1-45a9-9589-d05857625f83 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:50.723333 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:50.771178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:50.771866 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:50.772210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:50.772496 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:50.774115 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:50.774495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:50.775981 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:50.794020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 252/493] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:50.795541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:50.854552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728a4cf-724a-45da-a92f-cc56c2b283cb None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:50.916455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a971ca-492f-48e2-98be-782a603b71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:50.918331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a971ca-492f-48e2-98be-782a603b71e6 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:50.919155 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a971ca-492f-48e2-98be-782a603b71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:50.919527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a971ca-492f-48e2-98be-782a603b71e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:50.939693 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a971ca-492f-48e2-98be-782a603b71e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:50.943482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-a7a971ca-492f-48e2-98be-782a603b71e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:50.951946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:50.953603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:50.954644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 242/494] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:21:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:50.955806 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a971ca-492f-48e2-98be-782a603b71e6 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:50.972500 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1ae6-f58c-4713-8058-5aa16b5b88a8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:51.030453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:51.031123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:51.031416 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:51.031692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:51.032447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:51.032765 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:51.034929 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:51.056615 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 253/495] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:21:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:51.056615 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:51.097830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:51.121367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a971ca-492f-48e2-98be-782a603b71e6 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:51.171225 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:51.171786 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:51.172234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:51.172664 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:51.173658 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:51.174122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:51.176413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:51.246147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b56a-fae5-48b2-8a76-88ebc2c11aca None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:51.252401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 243/496] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 20:21:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:51.252401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:51.327113 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:51.328223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:51.328722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:51.329268 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:51.344871 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:51.348190 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:21:51.376403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:51.377489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 20:21:51.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:51.378935 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 254/497] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:21:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:51.380353 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:51.404405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:51.455776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e01737-b01f-4e20-b8e0-63c79c01865b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:51.511784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:51.512913 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:51.513466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:51.513973 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:51.515385 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] RBAC: Adding query filter params (name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:51.515955 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:51.518796 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:51.537597 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 244/498] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:21:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:51.539919 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:51.546821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:51.564046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb68ff0-5f47-413a-a577-1b69a0262d2e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:51.621249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:51.622055 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:51.622446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:51.622831 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:51.639892 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:51.642613 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:51.672498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:51.674132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:51.676186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:51.676186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:51.676186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:51.676186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:51.676186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 255/499] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:51.677078 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:51.742493 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19186e7a-de0d-466f-a0c8-b305108b159a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:51.783949 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:51.809704 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8e61c-e1eb-4f08-8ce4-a0337cf8bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:51.810783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8e61c-e1eb-4f08-8ce4-a0337cf8bce4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:51.811372 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8e61c-e1eb-4f08-8ce4-a0337cf8bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:51.811775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8e61c-e1eb-4f08-8ce4-a0337cf8bce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:51.847644 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf93f1-d9a3-45c4-a90d-43575ddba5c7 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:51.897567 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:51.898435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:51.898841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:51.899229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:51.900219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:51.900706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:51.902362 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:51.933354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8e61c-e1eb-4f08-8ce4-a0337cf8bce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:51.936113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8e61c-e1eb-4f08-8ce4-a0337cf8bce4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:51.941174 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:51.953486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 256/500] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 20:21:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:51.954361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:52.111067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 245/501] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:52.111067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8e61c-e1eb-4f08-8ce4-a0337cf8bce4 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:52.111470 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435e18-29e1-4542-955f-e54732afa5e1 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:52.129395 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:52.160446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:52.161583 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:52.162070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:52.162559 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:52.184848 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:52.187438 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:52.216087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:52.218201 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:52.219889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:52.219889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:52.219889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:52.219889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:52.219889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 257/502] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:52.219889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:52.304920 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8e61c-e1eb-4f08-8ce4-a0337cf8bce4 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:52.309990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:52.370156 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14072cec-b447-480c-ae09-2fe9c16c40b8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:52.371749 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:52.372814 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:52.373325 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:52.373807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:52.375143 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:52.375680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:52.378476 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:52.402040 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 246/503] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:52.403661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:52.444430 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913a08-0fbd-47a9-a714-0ec83349155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:52.445803 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913a08-0fbd-47a9-a714-0ec83349155f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:52.446302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913a08-0fbd-47a9-a714-0ec83349155f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:52.446781 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913a08-0fbd-47a9-a714-0ec83349155f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:52.521301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:52.562992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80913a08-0fbd-47a9-a714-0ec83349155f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:52.564724 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80913a08-0fbd-47a9-a714-0ec83349155f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:52.603537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4413eb-d84d-4ceb-a3d3-8f60b2361f2f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:52.666411 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:52.667284 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:52.667724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:52.668170 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:52.688572 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:52.691397 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:52.716866 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:52.718308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:52.720069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:52.720069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:52.720069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:52.720069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:52.720069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 247/504] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:52.720980 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:52.729866 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 258/505] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:52.731886 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913a08-0fbd-47a9-a714-0ec83349155f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:52.756787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:52.859292 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:52.894624 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8e7cd-f1bd-4bbe-907b-6e862917c586 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:52.919516 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913a08-0fbd-47a9-a714-0ec83349155f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:52.970305 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:52.971410 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:52.971918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:52.972423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:52.974276 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:52.975404 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:52.978017 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:52.981338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:52.982158 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:52.982528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:52.982908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:52.995914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:52.997498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:53.002066 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 248/506] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:53.003661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:21:53.014863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:53.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 259/507] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 20:21:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:53.018934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:53.162860 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:53.174410 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295b240-0750-4ba0-a827-2359f572bcd8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:53.206299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367064-c70b-4d6d-9764-c3acd2a878b8 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:53.234093 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:53.244294 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:53.245089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:53.245496 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:53.245891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:53.267548 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:53.270519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:53.275976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:53.277005 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:53.277554 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:53.278042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:53.279359 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:53.279897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:53.282558 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:53.297945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:53.299686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:53.302555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:53.302555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:53.302555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:53.302555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:53.302555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 260/508] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:53.302555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:53.314191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 249/509] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:53.314191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:53.462957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e36755-2fd1-4ea1-8234-908040649eef None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:53.503151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1b37b-3825-44e3-b135-68136069d28b None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:53.510893 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:53.511617 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:53.511967 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:53.512308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:53.513275 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:53.513722 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:53.515332 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:53.518930 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:53.545405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 250/510] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 20:21:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:53.546828 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:53.575384 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:53.576674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:53.577197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:53.577691 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:53.592907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:53.595180 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:21:53.615973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:53.618540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 261/511] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:21:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:53.620306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:53.703387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:53.722275 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2e7fa-3199-4b19-9520-418aca71df89 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:53.774543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:53.775538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:53.775948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:53.776384 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:53.777333 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:53.777816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:53.780103 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:53.801865 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 251/512] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:53.803852 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:53.826713 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225ba0-43ba-449c-82f6-76fe287d416a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:53.893657 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa924-a915-4338-85e2-626997907e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:53.894925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa924-a915-4338-85e2-626997907e40 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:53.895394 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa924-a915-4338-85e2-626997907e40 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:53.896035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa924-a915-4338-85e2-626997907e40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:53.896848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:53.910302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efa924-a915-4338-85e2-626997907e40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:53.913041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efa924-a915-4338-85e2-626997907e40 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-02efa924-a915-4338-85e2-626997907e40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:21:53.935057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:53.936795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:53.938514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 262/513] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:53.939402 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa924-a915-4338-85e2-626997907e40 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:53.991356 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705bc38-3054-462c-b9d0-18380fda4e39 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:54.065804 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d44b8-0859-49c5-b2de-b8bb4e71b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:54.066552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d44b8-0859-49c5-b2de-b8bb4e71b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:54.066916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d44b8-0859-49c5-b2de-b8bb4e71b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:54.067277 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d44b8-0859-49c5-b2de-b8bb4e71b2f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:54.131853 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa924-a915-4338-85e2-626997907e40 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:54.136087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:54.185984 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:54.186877 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:54.187318 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:54.187674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:54.188575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:54.188976 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:54.190609 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d44b8-0859-49c5-b2de-b8bb4e71b2f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:54.190802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:54.193649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d44b8-0859-49c5-b2de-b8bb4e71b2f6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:54.217611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 263/514] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Jul 25 20:21:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:54.219179 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:54.297986 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:54.377722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750e4d9-1b2b-449c-9a2b-6f4bb1c96888 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:54.390894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 252/515] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:54.392434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d44b8-0859-49c5-b2de-b8bb4e71b2f6 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:54.439473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:54.440571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:54.441066 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:54.441607 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:54.455596 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:54.457366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:21:54.476002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:54.478844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 264/516] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:54.480861 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:54.508171 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:54.575334 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d44b8-0859-49c5-b2de-b8bb4e71b2f6 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:54.633752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:54.634403 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:54.634792 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:54.635077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:54.635856 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:54.636165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:54.637816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:54.655731 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f46e8-2756-4b08-a055-1eff2e573c3a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:54.668803 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 253/517] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:21:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:54.670752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:54.700065 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:54.714941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78f27-eaad-4b46-a393-8f8b9707f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:54.716049 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78f27-eaad-4b46-a393-8f8b9707f450 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:54.716562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78f27-eaad-4b46-a393-8f8b9707f450 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:54.717072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78f27-eaad-4b46-a393-8f8b9707f450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:54.841163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793de36-66da-4c7e-a236-13a99473f7d8 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:54.843962 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d78f27-eaad-4b46-a393-8f8b9707f450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:54.846815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d78f27-eaad-4b46-a393-8f8b9707f450 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:54.879328 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:54.906950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:54.908044 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:54.908545 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:54.909037 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:54.930156 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:54.932903 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:54.956960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:54.958799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:54.960465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:54.960465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:54.960465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:54.960465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:54.960465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 254/518] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:54.960465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:55.013339 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 265/519] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:55.014535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78f27-eaad-4b46-a393-8f8b9707f450 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:55.052270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:55.095565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae9d3-5490-4016-92ba-cdecfcd76e0c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:55.153757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:55.154842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:55.155347 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:55.155848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:55.157470 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:55.157813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:55.160647 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:55.175343 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78f27-eaad-4b46-a393-8f8b9707f450 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:55.186446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 255/520] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:21:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:55.188193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:55.202846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:55.220101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:55.220723 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:55.221006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:55.221311 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:55.222118 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=79a68935bb7d41c793a288bce7fe7223) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:55.222429 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:55.223887 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:55.233955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 266/521] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:21:55 2022] GET /identity/v3/role_assignments?user.id=79a68935bb7d41c793a288bce7fe7223&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:55.235672 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:55.406558 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7698d3-1cf0-4eb4-b4be-50645b499061 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:55.445759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848723e-ef37-4c82-b522-5bcee7927c2d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:55.462951 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:55.481163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:55.481163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:55.481163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:55.481163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:55.481819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:55.481819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:55.481819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:55.495848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 256/522] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:55.496764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:55.502053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:55.502835 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:55.503253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:55.503535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:55.517731 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:55.519667 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:21:55.536683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:55.537882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:55.539369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:21:55.539369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:21:55.539369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:21:55.539369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:55.539369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 267/523] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:55.540112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:55.595482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:55.681811 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91856fd0-7a44-4a44-b989-8193f31546cb None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:55.715809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58749fd7-5ce2-481b-9702-2c9bbb61d41c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:55.750170 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:55.750880 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:55.751256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:55.751740 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:55.753095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=5834a66b3514487db2d99bad0d086030) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:55.753633 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:55.756046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:55.772261 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 257/524] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:21:55 2022] GET /identity/v3/role_assignments?user.id=5834a66b3514487db2d99bad0d086030&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:55.772261 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:55.799981 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5164413-7122-4f93-86ad-322197439458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:55.801601 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5164413-7122-4f93-86ad-322197439458 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:55.802601 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5164413-7122-4f93-86ad-322197439458 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:55.803200 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5164413-7122-4f93-86ad-322197439458 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:55.818875 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5164413-7122-4f93-86ad-322197439458 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:55.821903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5164413-7122-4f93-86ad-322197439458 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-a5164413-7122-4f93-86ad-322197439458 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:21:55.839417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:55.840728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:55.841841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:21:55.841841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:21:55.841841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:21:55.841841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:21:55.841841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:21:55.841841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:21:55.841841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:21:55.841841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:55.845775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 268/525] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:55.847298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5164413-7122-4f93-86ad-322197439458 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:55.878380 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:55.952831 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e6ad-350c-442f-a107-9e074ecdd11b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:55.999391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:56.000475 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:56.001051 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:56.001609 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:56.002873 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:56.003609 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:56.005505 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:56.029347 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 258/526] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:56.031963 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:56.061819 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:56.065661 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5164413-7122-4f93-86ad-322197439458 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:56.109361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:56.109990 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:56.110273 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:56.110578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:56.111355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:56.111661 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:56.113161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:56.134698 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 269/527] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:56.145538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:56.172027 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4280-1769-478b-80a3-13f51c874634 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:56.186501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:56.219968 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:56.221341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:56.222043 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:56.222568 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:56.235518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:56.238193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:21:56.265406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:56.267354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:56.269376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:21:56.269376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:21:56.269376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:21:56.269376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:21:56.269376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:21:56.269376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:21:56.269376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:21:56.269376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:56.277442 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 259/528] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:56.283485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:56.372250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0200b-25c3-4e8c-b646-79dd3aa99ad1 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:56.442092 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:56.443111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:56.443589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:56.444068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:56.446099 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=3f1ec071cc544cad97e00695b093c0ec) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:56.446760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:56.449693 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:56.462937 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 270/529] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:21:56 2022] GET /identity/v3/role_assignments?user.id=3f1ec071cc544cad97e00695b093c0ec&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:56.529744 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46045cd-292c-4068-a457-9743632e6025 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:56.603986 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b7da-512f-433e-9807-e0c070cfb505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:56.605042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b7da-512f-433e-9807-e0c070cfb505 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:56.605584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b7da-512f-433e-9807-e0c070cfb505 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:56.606075 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b7da-512f-433e-9807-e0c070cfb505 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:56.607681 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b7da-512f-433e-9807-e0c070cfb505 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:56.608242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b7da-512f-433e-9807-e0c070cfb505 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:56.611281 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b7da-512f-433e-9807-e0c070cfb505 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:56.636213 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 260/530] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:21:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:21:56.649793 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:56.697581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:56.873044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bb380-4bff-405e-bcf3-642168ce7c5f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:56.948646 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507650b3-a08a-4755-bc14-ba541cabefff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:56.950229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507650b3-a08a-4755-bc14-ba541cabefff None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:56.951030 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507650b3-a08a-4755-bc14-ba541cabefff None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:56.952073 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507650b3-a08a-4755-bc14-ba541cabefff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:56.954111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507650b3-a08a-4755-bc14-ba541cabefff None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=c82c5960cd2a459495388eb5fb1b1cbd) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:56.954983 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507650b3-a08a-4755-bc14-ba541cabefff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:56.958202 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507650b3-a08a-4755-bc14-ba541cabefff None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:56.971812 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 271/531] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:21:56 2022] GET /identity/v3/role_assignments?user.id=c82c5960cd2a459495388eb5fb1b1cbd&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:59.039855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67074cf-4504-417f-9c25-d4e96367af50 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:59.041457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67074cf-4504-417f-9c25-d4e96367af50 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:59.042267 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67074cf-4504-417f-9c25-d4e96367af50 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:59.047136 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 261/532] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:21:59.055676 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f3cd6-24f0-40b2-ada5-4d351c6968ad None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:59.057990 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f3cd6-24f0-40b2-ada5-4d351c6968ad None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:59.058796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f3cd6-24f0-40b2-ada5-4d351c6968ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:59.098501 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-5e5f3cd6-24f0-40b2-ada5-4d351c6968ad None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:59.101341 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-5e5f3cd6-24f0-40b2-ada5-4d351c6968ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:59.245279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 272/533] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:21:59.286748 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67074cf-4504-417f-9c25-d4e96367af50 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:59.359938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:59.364422 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660561-9080-4637-948a-30269667abff None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:59.365383 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660561-9080-4637-948a-30269667abff None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:59.366156 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660561-9080-4637-948a-30269667abff None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:59.369635 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 273/534] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:21:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:21:59.380246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec120ebe-28dc-4e2a-a829-53cc69b9a71e None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:59.381254 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec120ebe-28dc-4e2a-a829-53cc69b9a71e None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:59.382002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec120ebe-28dc-4e2a-a829-53cc69b9a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:59.417206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ec120ebe-28dc-4e2a-a829-53cc69b9a71e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:21:59.419717 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ec120ebe-28dc-4e2a-a829-53cc69b9a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:21:59.441421 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:59.509615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67074cf-4504-417f-9c25-d4e96367af50 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:59.565547 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 274/535] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:59.576541 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71777-4025-4976-ae3e-1ba30a65b349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:59.578050 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71777-4025-4976-ae3e-1ba30a65b349 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:59.578739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71777-4025-4976-ae3e-1ba30a65b349 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:59.579413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71777-4025-4976-ae3e-1ba30a65b349 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:59.602082 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc71777-4025-4976-ae3e-1ba30a65b349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:59.606158 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec120ebe-28dc-4e2a-a829-53cc69b9a71e None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-3bc71777-4025-4976-ae3e-1ba30a65b349 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:59.612331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:59.614070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:21:59.615192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 262/536] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:21:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:21:59.625879 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71777-4025-4976-ae3e-1ba30a65b349 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:59.796905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec120ebe-28dc-4e2a-a829-53cc69b9a71e None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:59.799269 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:59.815260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71777-4025-4976-ae3e-1ba30a65b349 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:21:59.888291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d4b34-d222-482d-a7f4-6a0c3fe944ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:59.889898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4b34-d222-482d-a7f4-6a0c3fe944ec None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:59.890683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4b34-d222-482d-a7f4-6a0c3fe944ec None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:59.891438 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4b34-d222-482d-a7f4-6a0c3fe944ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:59.895902 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:21:59.897178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:21:59.897777 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:21:59.899044 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:21:59.900737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] RBAC: Adding query filter params (name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:21:59.901602 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:21:59.904558 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:21:59.916349 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d4b34-d222-482d-a7f4-6a0c3fe944ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:21:59.923420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 263/537] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:21:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-4b2d4b34-d222-482d-a7f4-6a0c3fe944ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:21:59.927808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:21:59.930216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:21:59.931834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:21:59.935041 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:59.938159 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 275/538] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:21:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:21:59.948252 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d4b34-d222-482d-a7f4-6a0c3fe944ec None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:21:59.955665 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:00.156090 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1324-b859-4c24-b140-439cf15f003d None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:00.181778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d4b34-d222-482d-a7f4-6a0c3fe944ec None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:00.231149 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:00.232248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:00.232741 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:00.233268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:00.255743 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:00.259405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:00.264800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:00.266432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:00.267229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:00.268001 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:00.269688 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:00.270537 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:00.274291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:00.290474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:00.292187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:00.293964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:00.293964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:00.293964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:00.293964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:00.297515 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 276/539] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:21:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:00.298906 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 264/540] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:00.308310 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:00.308562 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:00.315282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:00.460910 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:00.537497 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f6d8b-99d5-41df-b79f-e575bc56edd3 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:00.538509 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736d3e-0980-40c7-b0a0-37c4969aa162 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:00.613988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:00.614507 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:00.615618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:00.616115 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:00.616519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:00.616674 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:00.619044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:00.619853 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:00.621547 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:00.622455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:00.625659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:00.640641 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:00.643543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:00.654607 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 277/541] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:00.668302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:00.683110 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:00.684776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:00.686533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:00.686533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:00.686533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:00.686533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:00.690231 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 265/542] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:00.700906 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:00.830022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:00.911465 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc887620-217f-45f6-a958-0f38d1d90cdb None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:00.925224 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d14f02-15d3-4486-aedb-6f1cd75b43c8 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:00.966715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:00.984540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:00.985688 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:00.986210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:00.986770 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:00.996576 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9be9ff-ad26-44c1-ab59-e32a263ae964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:00.996576 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be9ff-ad26-44c1-ab59-e32a263ae964 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:00.996576 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be9ff-ad26-44c1-ab59-e32a263ae964 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:00.996576 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be9ff-ad26-44c1-ab59-e32a263ae964 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:00.996996 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9be9ff-ad26-44c1-ab59-e32a263ae964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:00.997063 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9be9ff-ad26-44c1-ab59-e32a263ae964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:00.999700 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9be9ff-ad26-44c1-ab59-e32a263ae964 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:01.009366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:01.011162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:01.037201 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 266/543] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:01.037201 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf24d-0f96-483d-8e6c-588226706591 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.037201 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf24d-0f96-483d-8e6c-588226706591 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:01.037648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:01.038934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 20:22:01.041986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:01.043889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf24d-0f96-483d-8e6c-588226706591 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.043889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 267/544] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:01.043889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545bcd-11af-495f-964c-82a6d8d9190a None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.043889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545bcd-11af-495f-964c-82a6d8d9190a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.043889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c545bcd-11af-495f-964c-82a6d8d9190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.046445 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 278/545] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:22:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:01.047275 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:01.076654 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-8c545bcd-11af-495f-964c-82a6d8d9190a None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:01.078683 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-8c545bcd-11af-495f-964c-82a6d8d9190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:01.174267 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 268/546] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:01.175249 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c545bcd-11af-495f-964c-82a6d8d9190a None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:01.243627 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63785439-2c3e-4912-ad99-ee1e25e2b069 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:01.249670 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:01.306687 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fe6d2-db92-40fb-a9d7-9a4cf0e36881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:01.307751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fe6d2-db92-40fb-a9d7-9a4cf0e36881 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.308245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fe6d2-db92-40fb-a9d7-9a4cf0e36881 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.308746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fe6d2-db92-40fb-a9d7-9a4cf0e36881 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.310326 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fe6d2-db92-40fb-a9d7-9a4cf0e36881 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:01.310888 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fe6d2-db92-40fb-a9d7-9a4cf0e36881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:01.313709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fe6d2-db92-40fb-a9d7-9a4cf0e36881 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:01.324554 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c545bcd-11af-495f-964c-82a6d8d9190a None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:01.349226 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 279/547] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 20:22:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:01.351749 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda08aeb-c991-46eb-bb22-4b87b85e45f9 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.352251 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda08aeb-c991-46eb-bb22-4b87b85e45f9 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.352735 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda08aeb-c991-46eb-bb22-4b87b85e45f9 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.355017 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 280/548] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:01.356754 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda08aeb-c991-46eb-bb22-4b87b85e45f9 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:01.389229 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:01.390043 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.390517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.390888 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.403897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:01.405857 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:01.422204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:01.424162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 20:22:01.426923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:01.429668 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 269/549] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:22:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:01.431431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:01.452164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:01.563773 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda08aeb-c991-46eb-bb22-4b87b85e45f9 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:01.564053 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd3945-94db-4315-8eb6-ec3bc79e35cf None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:01.574021 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:01.613966 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f66439-d7e0-4327-b853-554287829faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:01.614805 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f66439-d7e0-4327-b853-554287829faa None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.615181 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f66439-d7e0-4327-b853-554287829faa None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.615657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f66439-d7e0-4327-b853-554287829faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.630992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd02ffd-ee8c-490f-afe0-3ccd5d2d05ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:01.631620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f66439-d7e0-4327-b853-554287829faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:01.631972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd02ffd-ee8c-490f-afe0-3ccd5d2d05ac None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.632417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd02ffd-ee8c-490f-afe0-3ccd5d2d05ac None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.633691 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd02ffd-ee8c-490f-afe0-3ccd5d2d05ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.634620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f66439-d7e0-4327-b853-554287829faa None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:01.655648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd02ffd-ee8c-490f-afe0-3ccd5d2d05ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-18f66439-d7e0-4327-b853-554287829faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:01.659517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:01.661434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:01.663148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:01.663148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:01.663148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:01.663148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:01.663148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 270/550] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:01.665683 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68341-6101-48d6-a882-e66e43b9a350 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-3cd02ffd-ee8c-490f-afe0-3ccd5d2d05ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:01.665883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:01.667540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:01.670834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:01.672273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68341-6101-48d6-a882-e66e43b9a350 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.672273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68341-6101-48d6-a882-e66e43b9a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.672556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 281/551] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:01.672556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd02ffd-ee8c-490f-afe0-3ccd5d2d05ac None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:01.696556 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-c0c68341-6101-48d6-a882-e66e43b9a350 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:01.698002 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-c0c68341-6101-48d6-a882-e66e43b9a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:01.828216 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 271/552] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:01.832214 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c68341-6101-48d6-a882-e66e43b9a350 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:01.871578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd02ffd-ee8c-490f-afe0-3ccd5d2d05ac None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:01.876871 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:01.933699 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:01.934587 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:01.934993 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:01.935524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:01.936610 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:01.937175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:01.939083 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:01.971709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 282/553] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 20:22:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:01.973374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:02.009456 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:02.028267 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c68341-6101-48d6-a882-e66e43b9a350 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:02.093693 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:02.094697 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:02.095195 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:02.095663 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:02.096585 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:02.097160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:02.099774 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:02.120341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 272/554] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:02.122035 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:02.171888 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee9c55-a81c-4157-8021-564f94b77640 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:02.239997 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:02.240914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:02.241439 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:02.242463 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:02.243550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:02.243550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:02.244969 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:02.254573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 283/555] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:22:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:02.256042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:02.269362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02efc68-48b6-4746-8370-7256be172172 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:02.294241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:02.316243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f202d2-36f8-4ec2-953e-be71908ba663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:02.317020 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f202d2-36f8-4ec2-953e-be71908ba663 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:02.317472 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f202d2-36f8-4ec2-953e-be71908ba663 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:02.317870 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f202d2-36f8-4ec2-953e-be71908ba663 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:02.332975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f202d2-36f8-4ec2-953e-be71908ba663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-45f202d2-36f8-4ec2-953e-be71908ba663 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:02.340610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:02.342837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 273/556] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:22:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:02.344876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f202d2-36f8-4ec2-953e-be71908ba663 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:02.358764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:02.405617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1c5c5-0e11-4c8b-a160-ac6fc182b55b None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:02.459379 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:02.460515 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:02.461048 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:02.461597 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:02.485520 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:02.488366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:02.509244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:02.511058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:02.512778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:02.512778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:02.512778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:02.512778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:02.513264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f202d2-36f8-4ec2-953e-be71908ba663 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:02.513435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 284/557] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:02.513435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:02.563585 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:02.564702 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:02.565262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:02.565761 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:02.580812 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:02.583699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:02.608574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:02.611197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 274/558] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:02.613095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:02.658451 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:02.693414 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceb0a4-d2f9-4735-88f1-5cd8e86dc602 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:02.719924 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:02.756679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:02.757893 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:02.758381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:02.758873 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:02.764829 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1728b-eb95-4bfb-8dfc-1b5750ffe042 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:02.780766 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:02.783738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:02.808655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:02.809343 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:02.809627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:02.809907 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:02.810649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] RBAC: Adding query filter params (name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:02.810958 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:02.812386 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:02.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:02.816413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:02.818364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:02.818364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:02.818364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:02.818364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:02.818364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 285/559] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:02.818364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:02.827565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 275/560] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:22:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:02.828470 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:02.986896 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003ece-12da-4fab-9b8e-3b8f9e339007 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:03.017562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70956a-f31f-450a-8ebb-9e48464a0c79 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:03.044784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:03.056266 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:03.057405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:03.057830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:03.058264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:03.059512 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:03.059974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:03.063134 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:03.064230 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:03.080563 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:03.081301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:03.081584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:03.081963 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:03.082692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:03.083060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:03.084507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:03.086255 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 276/561] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:03.087723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:03.100788 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 286/562] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:03.102319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:03.289044 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45a84-10b3-4a52-9ae0-303655e6df2b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:03.298063 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd523a9-cbb9-4a59-a4e5-ca1d9e64767d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:03.360066 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:03.361205 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:03.361706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:03.362218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:03.363546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:03.364114 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:03.366757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:03.372271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:03.373463 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:03.373953 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:03.374453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:03.395393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 277/563] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:03.397004 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:03.397331 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:03.400816 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:03.431922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:03.433844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:03.435593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:03.435593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:03.435593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:03.435593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:03.435593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 287/564] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:03.437212 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:03.508027 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:03.523988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:03.609238 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b28497-a618-47ac-8f8f-1029a43a192c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:03.614274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebeb7d-8e22-4b5d-a376-3f61f6990e36 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:03.678690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf1011-1875-4758-9082-f039e332cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:03.679785 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf1011-1875-4758-9082-f039e332cc1e None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:03.680243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf1011-1875-4758-9082-f039e332cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:03.680690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf1011-1875-4758-9082-f039e332cc1e None admin] PATH_INFO: `/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/79a68935bb7d41c793a288bce7fe7223/roles/c6eecb246d9a4b87b2e57fa42e7d033b` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:03.681082 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:03.682133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:03.682583 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:03.683029 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:03.694446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:03.697160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:03.708518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf1011-1875-4758-9082-f039e332cc1e None admin] RBAC: Authorizing `identity:create_grant(project_id=fcba1bed6cbb44dd8da5613751435133, user_id=79a68935bb7d41c793a288bce7fe7223, role_id=c6eecb246d9a4b87b2e57fa42e7d033b)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:03.710277 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf1011-1875-4758-9082-f039e332cc1e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:03.718900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:03.720931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 288/565] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:03.723166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:03.735052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 278/566] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:22:03 2022] PUT /identity/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/79a68935bb7d41c793a288bce7fe7223/roles/c6eecb246d9a4b87b2e57fa42e7d033b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:22:03.736175 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf1011-1875-4758-9082-f039e332cc1e None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:03.924632 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:03.931168 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f6af-f834-4829-b461-8b633b0129d8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:03.937297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:03.943537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf1011-1875-4758-9082-f039e332cc1e None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:03.990922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:03.991943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:03.993141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:03.993141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:04.004511 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:04.006699 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:04.021798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:04.022988 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:04.024211 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:04.024726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:04.025528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:04.027577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:04.029760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:04.031011 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:04.031310 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:04.034109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:04.035037 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 289/567] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 20:22:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:04.040286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:04.068639 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 279/568] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:04.072329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:04.270134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5631f1-3b2f-456b-a8e0-79c4385940f0 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:04.292476 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80683-dbcc-43f5-8adb-de8557c2eb8b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:04.344683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:04.345806 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:04.346412 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:04.346769 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:04.348182 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:04.348939 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:04.352316 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:04.367886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:04.369060 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:04.369700 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:04.370216 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:04.372036 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:04.372588 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:04.375396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:04.378490 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 290/569] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:04.381812 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:04.413334 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 280/570] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 20:22:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:04.415873 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:04.436312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:04.458463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:04.610600 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ec7ca-cbd5-435d-aeeb-342e24aec4e4 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:04.647196 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9319-676a-4293-9c04-1948ed18f510 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:04.686328 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:04.687465 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:04.687956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:04.688503 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:04.704457 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:04.707358 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:04.721839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f20db-8000-414a-b203-c9434eb4ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:04.723001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f20db-8000-414a-b203-c9434eb4ecc2 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:04.723461 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f20db-8000-414a-b203-c9434eb4ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:04.723924 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f20db-8000-414a-b203-c9434eb4ecc2 None admin] PATH_INFO: `/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/5834a66b3514487db2d99bad0d086030/roles/c6eecb246d9a4b87b2e57fa42e7d033b` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:04.733572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:04.735405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 291/571] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:22:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:04.738187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:04.764782 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f20db-8000-414a-b203-c9434eb4ecc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcba1bed6cbb44dd8da5613751435133, user_id=5834a66b3514487db2d99bad0d086030, role_id=c6eecb246d9a4b87b2e57fa42e7d033b)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:04.768458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f20db-8000-414a-b203-c9434eb4ecc2 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:04.801162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 281/572] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:22:04 2022] PUT /identity/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/5834a66b3514487db2d99bad0d086030/roles/c6eecb246d9a4b87b2e57fa42e7d033b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:22:04.801162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f20db-8000-414a-b203-c9434eb4ecc2 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:04.949471 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:04.996067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:04.998183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a90fa-c9b2-411e-a3d4-3dee806c10fe None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:05.058876 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:05.059813 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:05.060197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:05.062669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:05.078314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:05.080009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:05.082465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f20db-8000-414a-b203-c9434eb4ecc2 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:05.103833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:05.105846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:05.108027 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:05.108027 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:05.108027 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:05.108027 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:05.108027 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 292/573] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:05.115957 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:05.154830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:05.155848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:05.156199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:05.156535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:05.157729 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:05.158240 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:05.160315 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:05.187271 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 282/574] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Jul 25 20:22:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:05.193052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:05.353221 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902858b-3f1b-4df2-befb-4974dfbbc5b8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:05.388079 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef715c-9f7f-4004-8459-f15751afd3d0 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:05.416740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:05.426896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:05.428004 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:05.429322 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:05.431021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:05.432469 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:05.433168 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:05.436697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:05.454596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:05.469901 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 293/575] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:05.473411 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:05.475089 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:05.475833 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:05.476067 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:05.477337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:05.500119 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:05.503635 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:05.535080 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:05.536898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:05.538731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:05.538731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:05.538731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:05.538731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:05.543415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 283/576] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:05.553050 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:05.696055 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaa06d-aa96-4432-9de3-ef23dd319bda None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:05.766688 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:05.767491 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481e0a-1bf6-4134-aa21-389d60adb1d3 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:05.768035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:05.768586 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:05.769168 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:05.783825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:05.786934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:05.812737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:05.814669 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:05.817139 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 294/577] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:05.825170 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:05.855589 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:05.857246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:05.858581 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:05.859501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:05.861374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:05.862099 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:05.865518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:05.901705 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 284/578] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:05.907432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:05.947903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:06.007266 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:06.074543 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d54df-0a5c-43e7-ba80-ba47050b4da1 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:06.161155 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:06.163023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:06.165666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:06.166195 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:06.167478 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:06.167970 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:06.170546 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:06.180458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083aaac-18c7-4baa-a846-dd2ddeabc275 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:06.206090 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 295/579] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:06.210203 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:06.273501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:06.276675 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:06.277704 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:06.278607 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:06.297701 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:06.301538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:06.327415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:06.329303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:06.331094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 285/580] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:06.342343 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:06.464277 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911eb16-0673-4927-b6cc-d8e297c123e2 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:06.495499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:06.544973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481a342-cb19-488b-9822-bac62546359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:06.546276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a342-cb19-488b-9822-bac62546359c None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:06.546774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a342-cb19-488b-9822-bac62546359c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:06.547253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a342-cb19-488b-9822-bac62546359c None admin] PATH_INFO: `/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/3f1ec071cc544cad97e00695b093c0ec/roles/c6eecb246d9a4b87b2e57fa42e7d033b` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:06.568011 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:06.578220 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173ae14-c4f4-492d-9464-fef94b4aa9b5 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:06.580994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481a342-cb19-488b-9822-bac62546359c None admin] RBAC: Authorizing `identity:create_grant(project_id=fcba1bed6cbb44dd8da5613751435133, user_id=3f1ec071cc544cad97e00695b093c0ec, role_id=c6eecb246d9a4b87b2e57fa42e7d033b)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:06.583844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481a342-cb19-488b-9822-bac62546359c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:06.621209 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 296/581] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:22:06 2022] PUT /identity/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/3f1ec071cc544cad97e00695b093c0ec/roles/c6eecb246d9a4b87b2e57fa42e7d033b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:22:06.657530 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43270bb2-c7a7-4cb0-95f7-0836a40579b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:06.658894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43270bb2-c7a7-4cb0-95f7-0836a40579b4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:06.659698 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43270bb2-c7a7-4cb0-95f7-0836a40579b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:06.660447 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43270bb2-c7a7-4cb0-95f7-0836a40579b4 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:06.662362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43270bb2-c7a7-4cb0-95f7-0836a40579b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:06.663072 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43270bb2-c7a7-4cb0-95f7-0836a40579b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:06.665760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43270bb2-c7a7-4cb0-95f7-0836a40579b4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:06.683282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 286/582] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:06.691211 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481a342-cb19-488b-9822-bac62546359c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:06.854081 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481a342-cb19-488b-9822-bac62546359c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:06.902554 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c17c-1621-4f09-86b3-628044ddcfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:06.903318 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c17c-1621-4f09-86b3-628044ddcfd4 None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:06.903605 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c17c-1621-4f09-86b3-628044ddcfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:06.903894 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c17c-1621-4f09-86b3-628044ddcfd4 None admin] PATH_INFO: `/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/c82c5960cd2a459495388eb5fb1b1cbd/roles/c6eecb246d9a4b87b2e57fa42e7d033b` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:06.924342 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c17c-1621-4f09-86b3-628044ddcfd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcba1bed6cbb44dd8da5613751435133, user_id=c82c5960cd2a459495388eb5fb1b1cbd, role_id=c6eecb246d9a4b87b2e57fa42e7d033b)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:06.926177 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c17c-1621-4f09-86b3-628044ddcfd4 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:06.949404 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 297/583] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:22:06 2022] PUT /identity/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/c82c5960cd2a459495388eb5fb1b1cbd/roles/c6eecb246d9a4b87b2e57fa42e7d033b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:22:07.456119 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5468ad-546e-4671-971f-a672f8538d6b None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:07.456437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5468ad-546e-4671-971f-a672f8538d6b None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:07.456775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5468ad-546e-4671-971f-a672f8538d6b None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:07.458946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 287/584] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:22:07.465665 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee8db-9585-475a-9b4e-53749a0f913d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:07.466491 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee8db-9585-475a-9b4e-53749a0f913d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:07.466491 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee8db-9585-475a-9b4e-53749a0f913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:07.490594 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-e0bee8db-9585-475a-9b4e-53749a0f913d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:07.492934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-e0bee8db-9585-475a-9b4e-53749a0f913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:07.503430 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:07.609274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 298/585] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:07.629982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5468ad-546e-4671-971f-a672f8538d6b None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:07.857881 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5468ad-546e-4671-971f-a672f8538d6b None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:07.931334 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6005-8ce1-49fd-bda4-21214b84f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:07.933236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6005-8ce1-49fd-bda4-21214b84f0cc None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:07.934030 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6005-8ce1-49fd-bda4-21214b84f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:07.934823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6005-8ce1-49fd-bda4-21214b84f0cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:07.957615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb6005-8ce1-49fd-bda4-21214b84f0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-82bb6005-8ce1-49fd-bda4-21214b84f0cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:07.970543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:07.972361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:07.974889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:07.979959 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 288/586] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:22:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:07.990111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee8db-9585-475a-9b4e-53749a0f913d None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:08.202432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee8db-9585-475a-9b4e-53749a0f913d None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:08.250169 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:08.250920 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:08.251222 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:08.251480 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:08.252242 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:08.252552 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:08.254261 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:08.268360 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 299/587] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:22:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:08.281507 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6005-8ce1-49fd-bda4-21214b84f0cc None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:08.326461 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:08.480870 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6005-8ce1-49fd-bda4-21214b84f0cc None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:08.522670 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:08.524314 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:08.525044 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:08.525357 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:08.539799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:08.541515 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:08.560290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:08.562537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:08.564551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:08.564551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:08.564551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:08.564551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:08.564551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 289/588] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:08.567573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:08.573457 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:08.704730 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76acb-6b39-4a55-aa83-6bc52e9c89ce None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:08.779788 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db13b8b-b090-4726-bf90-f3893850aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:08.780763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13b8b-b090-4726-bf90-f3893850aca8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:08.781303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13b8b-b090-4726-bf90-f3893850aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:08.781800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13b8b-b090-4726-bf90-f3893850aca8 None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:08.783022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db13b8b-b090-4726-bf90-f3893850aca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:08.783552 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db13b8b-b090-4726-bf90-f3893850aca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:08.786180 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db13b8b-b090-4726-bf90-f3893850aca8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:08.814407 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 300/589] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:08.824418 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:08.979574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:09.048478 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1aa5f-233b-49ab-8adf-0a4a64c3629f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:09.091853 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146ea3-014c-4e6e-b0be-f5a59eee1ba7 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:09.092302 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146ea3-014c-4e6e-b0be-f5a59eee1ba7 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:09.092777 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146ea3-014c-4e6e-b0be-f5a59eee1ba7 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:09.101350 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 301/590] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:22:09.105841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7a3b-93b7-40f1-9b9e-c76e9f0bf1ba None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:09.106309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7a3b-93b7-40f1-9b9e-c76e9f0bf1ba None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:09.106765 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7a3b-93b7-40f1-9b9e-c76e9f0bf1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:09.122186 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:09.123233 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:09.123687 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:09.124130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:09.138131 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:09.140414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:09.142109 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-548c7a3b-93b7-40f1-9b9e-c76e9f0bf1ba None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:09.144476 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-548c7a3b-93b7-40f1-9b9e-c76e9f0bf1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:09.163527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:09.166297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 20:22:09.168791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:09.177138 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 290/591] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:22:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:09.177138 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:09.282099 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:09.309265 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 302/592] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:09.354844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c7a3b-93b7-40f1-9b9e-c76e9f0bf1ba None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:09.396550 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd064e-a779-49e8-9255-3662d21ef9b8 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:09.454906 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:09.467847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:09.468849 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:09.469370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:09.469851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:09.471284 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:09.471807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:09.474539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:09.515970 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 291/593] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 20:22:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:09.522976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:09.583694 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c7a3b-93b7-40f1-9b9e-c76e9f0bf1ba None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:09.660132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6607ea1-3612-45e7-9d89-22d2c3ad5958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:09.662074 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6607ea1-3612-45e7-9d89-22d2c3ad5958 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:09.662985 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6607ea1-3612-45e7-9d89-22d2c3ad5958 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:09.663777 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6607ea1-3612-45e7-9d89-22d2c3ad5958 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:09.686983 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6607ea1-3612-45e7-9d89-22d2c3ad5958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-e6607ea1-3612-45e7-9d89-22d2c3ad5958 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:09.698135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:09.699977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:09.701681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:09.716133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 303/594] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:22:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:09.718705 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6607ea1-3612-45e7-9d89-22d2c3ad5958 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:09.746790 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacafc3-65b4-4244-b56d-b75b4410b854 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:09.815520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc091c-1d20-481e-b7bf-1d454c38acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:09.816564 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc091c-1d20-481e-b7bf-1d454c38acfe None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:09.817051 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc091c-1d20-481e-b7bf-1d454c38acfe None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:09.817582 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc091c-1d20-481e-b7bf-1d454c38acfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:09.840905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:09.936726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:09.950575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6607ea1-3612-45e7-9d89-22d2c3ad5958 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:09.962875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc091c-1d20-481e-b7bf-1d454c38acfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:09.965546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc091c-1d20-481e-b7bf-1d454c38acfe None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:10.024603 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:10.026307 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:10.027038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:10.027705 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:10.029335 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:10.030111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:10.033182 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:10.057267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 304/595] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:22:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:10.062209 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:10.167242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 292/596] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:10.167242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9b95d-1cd5-4d51-b845-fbf18fa434ff None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:10.167242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9b95d-1cd5-4d51-b845-fbf18fa434ff None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:10.167242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9b95d-1cd5-4d51-b845-fbf18fa434ff None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:10.167242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 293/597] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:10.172631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9b95d-1cd5-4d51-b845-fbf18fa434ff None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:10.279925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8017-8e3e-4b5a-a94d-77bab6fe46dd None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:10.317175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:10.338390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:10.359556 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9b95d-1cd5-4d51-b845-fbf18fa434ff None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:10.359855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7cacc-08aa-4cff-a375-4a5d6d4b4bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:10.360752 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7cacc-08aa-4cff-a375-4a5d6d4b4bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:10.361297 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7cacc-08aa-4cff-a375-4a5d6d4b4bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:10.361772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7cacc-08aa-4cff-a375-4a5d6d4b4bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:10.385774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7cacc-08aa-4cff-a375-4a5d6d4b4bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:10.388844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7cacc-08aa-4cff-a375-4a5d6d4b4bc5 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:10.409027 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:10.409729 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:10.410019 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:10.410286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-37e7cacc-08aa-4cff-a375-4a5d6d4b4bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:10.419089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:10.420453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:10.421967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:10.421967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:10.421967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:10.421967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:10.422820 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:10.423872 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:10.425590 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 305/598] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:10.428893 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b921-a97b-4030-ae99-a7753ae83412 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:10.430207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b921-a97b-4030-ae99-a7753ae83412 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:10.430701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b921-a97b-4030-ae99-a7753ae83412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:10.443499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:10.448235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:10.458299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:10.458299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:10.458299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:10.458299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:10.458299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 294/599] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:10.458299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:10.458832 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-56c1b921-a97b-4030-ae99-a7753ae83412 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:10.459402 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-56c1b921-a97b-4030-ae99-a7753ae83412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:10.584107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 306/600] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:10.585086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1b921-a97b-4030-ae99-a7753ae83412 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:10.638098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff1772-4440-4f99-83ed-ff0adf85a335 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:10.695344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:10.696703 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:10.697244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:10.697709 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:10.699136 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:10.701489 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:10.701489 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:10.718914 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:10.729709 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 295/601] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:10.732701 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:10.763572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:10.769329 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1b921-a97b-4030-ae99-a7753ae83412 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:10.826098 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:10.826420 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:10.826607 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:10.826879 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:10.827452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:10.827839 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:10.829367 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:10.850773 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 307/602] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:10.850773 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:10.934878 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3c624-6bb3-4750-9266-152df55b3a2f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:10.981356 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba221b-d4f7-4424-913b-8b57d310064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:10.982353 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba221b-d4f7-4424-913b-8b57d310064b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:10.982793 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba221b-d4f7-4424-913b-8b57d310064b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:10.983248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba221b-d4f7-4424-913b-8b57d310064b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.009515 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba221b-d4f7-4424-913b-8b57d310064b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-1eba221b-d4f7-4424-913b-8b57d310064b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:11.019847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:11.022097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 296/603] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:22:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:11.024246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba221b-d4f7-4424-913b-8b57d310064b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:11.051457 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876c530-0276-4e72-b2f5-3ef5b1bef049 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:11.125179 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d267725-84cd-49a2-854b-92aecf9efaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:11.126370 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d267725-84cd-49a2-854b-92aecf9efaef None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:11.126875 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d267725-84cd-49a2-854b-92aecf9efaef None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:11.127550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d267725-84cd-49a2-854b-92aecf9efaef None admin] PATH_INFO: `/v3/users/glance` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.143588 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d267725-84cd-49a2-854b-92aecf9efaef None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:11.145375 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:11.147031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d267725-84cd-49a2-854b-92aecf9efaef None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-7d267725-84cd-49a2-854b-92aecf9efaef None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:11.171250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:11.172423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 20:22:11.173448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:11.174530 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 308/604] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:22:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:11.175877 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe109-e7da-4824-892b-8f256d6b6931 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:11.176643 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe109-e7da-4824-892b-8f256d6b6931 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:11.177170 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe109-e7da-4824-892b-8f256d6b6931 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.182914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 309/605] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:11.183172 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe109-e7da-4824-892b-8f256d6b6931 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:11.218508 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba221b-d4f7-4424-913b-8b57d310064b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:11.221678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:11.268618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:11.269349 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:11.269698 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:11.270131 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.279876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:11.281679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:11.296570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:11.298474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 297/606] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:11.300912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:11.395020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe109-e7da-4824-892b-8f256d6b6931 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:11.446119 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca6ed-8a1c-4303-b83a-1a6e648ae9b6 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:11.457315 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e3654-179d-47ca-aa60-0da5870cbe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:11.457946 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3654-179d-47ca-aa60-0da5870cbe4a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:11.458226 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3654-179d-47ca-aa60-0da5870cbe4a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:11.458500 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e3654-179d-47ca-aa60-0da5870cbe4a None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.459291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e3654-179d-47ca-aa60-0da5870cbe4a None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:11.459597 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e3654-179d-47ca-aa60-0da5870cbe4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:11.461335 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e3654-179d-47ca-aa60-0da5870cbe4a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:11.473325 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 310/607] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:22:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:11.475701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a282c-a4b7-4fba-970c-ee47d23fb1ba None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:11.476082 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a282c-a4b7-4fba-970c-ee47d23fb1ba None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:11.477550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a282c-a4b7-4fba-970c-ee47d23fb1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.491836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:11.506328 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-f17a282c-a4b7-4fba-970c-ee47d23fb1ba None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:11.508527 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-f17a282c-a4b7-4fba-970c-ee47d23fb1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:11.511853 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:11.512500 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:11.512779 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:11.513054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.513912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:11.514304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:11.515797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:11.538831 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 298/608] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 20:22:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:11.540128 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:11.618766 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 311/609] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:11.619664 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a282c-a4b7-4fba-970c-ee47d23fb1ba None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:11.633056 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:11.696694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afbbfe-6df5-4bad-8f98-c08e05761fe6 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:11.750313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a282c-a4b7-4fba-970c-ee47d23fb1ba None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:11.762291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:11.763317 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:11.763798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:11.764286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.765760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:11.766300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:11.769031 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:11.804891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 299/610] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:11.804891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:11.808132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:11.809307 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:11.810127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:11.810576 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:11.833051 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:11.837913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:11.872266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:11.874181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:11.876068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:11.876068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:11.876068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:11.876068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:11.879416 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 312/611] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:11.881319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:11.886216 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:12.004098 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:12.015038 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c45915-d95f-482d-8aa9-bc5da9ed1024 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:12.095843 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee959e-7559-4099-8c93-b45d02f4a3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:12.097216 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee959e-7559-4099-8c93-b45d02f4a3b0 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:12.097764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee959e-7559-4099-8c93-b45d02f4a3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:12.098269 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee959e-7559-4099-8c93-b45d02f4a3b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:12.103658 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9efa61-ccff-451a-90c1-c647462e2599 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:12.158896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c18402-765c-4b97-9c40-0f3701864dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:12.159770 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c18402-765c-4b97-9c40-0f3701864dc2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:12.160057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c18402-765c-4b97-9c40-0f3701864dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:12.160341 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c18402-765c-4b97-9c40-0f3701864dc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:12.181469 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c18402-765c-4b97-9c40-0f3701864dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-79c18402-765c-4b97-9c40-0f3701864dc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:12.187388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:12.189440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 313/612] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:22:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:12.191127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c18402-765c-4b97-9c40-0f3701864dc2 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:12.255537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee959e-7559-4099-8c93-b45d02f4a3b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:12.260244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee959e-7559-4099-8c93-b45d02f4a3b0 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:12.338912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:12.403426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c18402-765c-4b97-9c40-0f3701864dc2 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:12.445909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:12.452150 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 300/613] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:12.453583 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee959e-7559-4099-8c93-b45d02f4a3b0 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:12.469903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:12.470989 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:12.471498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:12.472000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:12.473592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=79a68935bb7d41c793a288bce7fe7223) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:12.474158 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:12.477137 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:12.493192 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 314/614] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:22:12 2022] GET /identity/v3/role_assignments?user.id=79a68935bb7d41c793a288bce7fe7223&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:12.493192 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:12.655336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee959e-7559-4099-8c93-b45d02f4a3b0 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:12.721909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feab55-140c-4ecb-a923-7b6da3c6d267 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:12.731321 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:12.732855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:12.733990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:12.734808 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:12.736499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:12.738678 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:12.743352 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:12.759916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:12.775225 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 301/615] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:12.777165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:12.807234 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:12.808693 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:12.809225 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:12.809746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:12.811238 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:12.811691 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:12.814519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:12.833427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 315/616] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:22:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:12.835065 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:12.941558 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:12.997933 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae8e0-0b2e-4867-991a-997ba3f02ddc None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:13.029595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef7af8-9058-4086-896e-b90afe5abf58 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:13.080093 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:13.081608 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:13.081781 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:13.082277 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:13.099769 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:13.100698 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:13.101327 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:13.102443 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:13.106520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:13.109489 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:13.117911 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:13.120766 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:13.139538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:13.141787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:13.143501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:13.143501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:13.143501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:13.143501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:13.143924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:13.145674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:13.150022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 316/617] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 20:22:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:13.154385 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 302/618] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:13.154695 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:13.154957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:13.261664 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:13.326959 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76393a2-bc60-4b37-9296-ac4e73989265 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:13.341283 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:13.371390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883386c-36ba-4a77-a648-90fff2b9ce44 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:13.380499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:13.381409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:13.381824 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:13.382229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:13.397511 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:13.400163 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:13.419446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:13.420943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:13.422759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:13.422759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:13.422759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:13.422759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:13.425632 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 317/619] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:13.428116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:13.449195 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:13.450259 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:13.450766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:13.451611 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:13.452698 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:13.453236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:13.455820 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:13.488732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 303/620] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 20:22:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:13.489903 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:13.621432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273054a-9dce-44de-8318-7aae54a491de None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:13.668977 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f697dc3-bec9-4d97-9e56-94e423b97483 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:13.682388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:13.683353 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:13.683784 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:13.684206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:13.685211 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:13.685840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:13.687444 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:13.690762 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:13.712036 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 318/621] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:13.712692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:13.740283 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:13.741319 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:13.742228 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:13.744192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:13.744695 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:13.746073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:13.746634 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:13.749358 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:13.772807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 304/622] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:13.775310 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:13.869384 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf304db-3601-4ef8-adf3-de4a9ff42c85 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:13.920060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb92c5-3960-4182-a92f-af837b719138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:13.920760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb92c5-3960-4182-a92f-af837b719138 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:13.921329 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb92c5-3960-4182-a92f-af837b719138 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:13.921695 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb92c5-3960-4182-a92f-af837b719138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:13.984385 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dcac4-03a2-4361-8a68-e0e5a3b79bc5 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:14.048722 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:14.049846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:14.050357 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:14.050798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:14.053259 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb92c5-3960-4182-a92f-af837b719138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:14.059992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb92c5-3960-4182-a92f-af837b719138 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:14.065064 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:14.066870 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:14.091485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:14.094393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:14.096209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 305/623] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:14.104456 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:14.108352 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:14.160679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:14.251780 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 319/624] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:14.251780 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb92c5-3960-4182-a92f-af837b719138 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:14.338790 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1692a-b093-4b21-95f3-2eb7bbb3afc1 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:14.403055 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:14.404285 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:14.404831 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:14.405364 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:14.421784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:14.424680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:14.451594 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb92c5-3960-4182-a92f-af837b719138 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:14.459992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:14.462218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 20:22:14.463346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:14.465498 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 306/625] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:22:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:14.466761 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:14.507566 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:14.543590 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:14.545908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:14.547061 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:14.547519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:14.549619 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:14.550442 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:14.553519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:14.586616 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 320/626] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:14.586616 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:14.640757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:14.668897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c17f-18ba-4eb4-90f7-d5dfdb8ca508 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:14.719393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:14.720226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:14.720635 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:14.721241 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:14.738395 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:14.740824 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:14.761248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:14.762962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:14.764706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:14.764706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:14.764706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:14.764706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:14.767786 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 307/627] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:14.769480 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:14.813600 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e2aa-c982-4072-a69a-01db7f07b959 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:14.872386 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:14.875653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:14.876143 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:14.876626 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:14.878208 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:14.878750 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:14.881746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:14.929456 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 321/628] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Jul 25 20:22:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:14.929456 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:14.984549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c073d4d-b084-4534-8481-92c24fa6f0e4 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:15.016896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:15.069777 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:15.071379 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:15.071820 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:15.072269 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:15.073693 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=5834a66b3514487db2d99bad0d086030) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:15.074179 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:15.076614 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:15.097143 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 308/629] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:22:14 2022] GET /identity/v3/role_assignments?user.id=5834a66b3514487db2d99bad0d086030&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:15.097143 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:15.100994 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:15.183822 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2322b-040a-4ff2-98b5-120f23db9c70 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:15.264444 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:15.265711 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:15.266179 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:15.266638 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:15.267999 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:15.268421 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:15.271034 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:15.295634 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 322/630] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:15.302620 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:15.345443 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46210-10ab-4b96-95c5-4c9de6101bc7 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:15.418899 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cef84-c040-4373-9294-5e3f543e5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:15.421324 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cef84-c040-4373-9294-5e3f543e5d20 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:15.421324 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cef84-c040-4373-9294-5e3f543e5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:15.421324 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cef84-c040-4373-9294-5e3f543e5d20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:15.525209 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:15.533972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982202-97d5-47ed-8f96-49dd3f40a58f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:15.574396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cef84-c040-4373-9294-5e3f543e5d20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:15.577764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cef84-c040-4373-9294-5e3f543e5d20 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:15.585844 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:15.609929 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:15.612112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:15.613375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:15.613876 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:15.629472 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:15.632473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:15.655761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:15.657535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:15.659308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:15.659308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:15.659308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:15.659308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:15.659308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:15.659308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:15.659308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:15.659308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:15.663475 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 323/631] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:15.675101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:15.793703 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 309/632] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:22:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:15.800367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cef84-c040-4373-9294-5e3f543e5d20 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:15.918631 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c83784-7c1d-40cb-9c7a-07874c8074fd None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:15.987194 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:15.988845 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:15.989676 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:15.990421 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:15.992042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:15.993545 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:15.996425 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:16.020902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 324/633] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:16.029660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cef84-c040-4373-9294-5e3f543e5d20 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:16.040183 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:16.042581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:16.088031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:16.113926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:16.115390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:16.115837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:16.116342 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:16.138828 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:16.142095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:16.176979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:16.178724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:16.180990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:16.180990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:16.180990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:16.180990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:16.180990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 310/634] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:16.190286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:16.281314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1571b84-9ee5-405a-b5a6-e13974c61379 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:16.326374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3824a-6772-4a66-b3ff-12f928cd2eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:16.327218 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3824a-6772-4a66-b3ff-12f928cd2eb7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:16.327506 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3824a-6772-4a66-b3ff-12f928cd2eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:16.327779 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3824a-6772-4a66-b3ff-12f928cd2eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:16.328790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3824a-6772-4a66-b3ff-12f928cd2eb7 None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=3f1ec071cc544cad97e00695b093c0ec) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:16.329145 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3824a-6772-4a66-b3ff-12f928cd2eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:16.331901 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3824a-6772-4a66-b3ff-12f928cd2eb7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:16.343980 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 325/635] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:22:16 2022] GET /identity/v3/role_assignments?user.id=3f1ec071cc544cad97e00695b093c0ec&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:16.356386 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cd6f8-e967-44a5-9f14-6eefa5d1ecff None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:16.406770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:16.407436 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:16.407717 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:16.407994 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:16.408723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:16.409029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:16.410531 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:16.413797 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581fee-247d-420e-aaf5-739bffc4d16d None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:16.414854 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581fee-247d-420e-aaf5-739bffc4d16d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:16.415363 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581fee-247d-420e-aaf5-739bffc4d16d None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:16.418685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 326/636] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:22:16.424570 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369828b9-9e68-422a-a215-ddfb2f3351ee None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:16.424835 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369828b9-9e68-422a-a215-ddfb2f3351ee None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:16.425140 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369828b9-9e68-422a-a215-ddfb2f3351ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:16.428194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 311/637] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:16.434577 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:16.447661 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-369828b9-9e68-422a-a215-ddfb2f3351ee None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:16.449094 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-369828b9-9e68-422a-a215-ddfb2f3351ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:16.473696 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:16.557291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 327/638] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:16.575760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369828b9-9e68-422a-a215-ddfb2f3351ee None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:16.592590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46655e-bbed-4d17-a0de-d94786a25218 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:16.595044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:16.644384 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:16.645055 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:16.645372 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:16.645654 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:16.653489 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:16.655001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:16.670770 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:16.671784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:16.672867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 312/639] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:16.679701 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:16.732380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369828b9-9e68-422a-a215-ddfb2f3351ee None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:16.790268 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:16.790940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:16.791223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:16.791498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:16.792161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:16.794455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:16.797534 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:16.816435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:16.817572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:16.818653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:16.825746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 328/640] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Jul 25 20:22:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:16.830312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:16.834898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9e7f6-1c58-4ef2-b191-9d189aa25b53 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:16.885784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:16.886343 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:16.887190 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:16.887539 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:16.888875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:16.889217 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:16.890760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:16.915631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 313/641] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:16.916808 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:16.982783 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:17.015733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656745f3-a15a-4ccb-986e-f24658fcc468 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:17.090733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:17.092948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:17.093783 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:17.094550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:17.096971 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:17.097846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:17.103195 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:17.112750 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8444-0f13-4be2-b8f3-9e3aadae0261 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:17.115064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 329/642] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 20:22:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:17.124346 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:17.171065 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7228-3235-49c4-a764-765e3673b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:17.171893 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7228-3235-49c4-a764-765e3673b553 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:17.172255 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7228-3235-49c4-a764-765e3673b553 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:17.172581 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7228-3235-49c4-a764-765e3673b553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:17.173528 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7228-3235-49c4-a764-765e3673b553 None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=c82c5960cd2a459495388eb5fb1b1cbd) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:17.173850 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7228-3235-49c4-a764-765e3673b553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:17.176698 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7228-3235-49c4-a764-765e3673b553 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:17.183242 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:17.201405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 314/643] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:22:16 2022] GET /identity/v3/role_assignments?user.id=c82c5960cd2a459495388eb5fb1b1cbd&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:17.370011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24413403-736a-40e2-b0c5-7a055886c3b6 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:17.427957 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd640-cfd9-4432-8e79-a1bc77dd0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:17.428715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd640-cfd9-4432-8e79-a1bc77dd0b01 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:17.429000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd640-cfd9-4432-8e79-a1bc77dd0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:17.429376 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd640-cfd9-4432-8e79-a1bc77dd0b01 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:17.430893 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd640-cfd9-4432-8e79-a1bc77dd0b01 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:17.431345 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd640-cfd9-4432-8e79-a1bc77dd0b01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:17.434091 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd640-cfd9-4432-8e79-a1bc77dd0b01 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:17.442812 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 330/644] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 20:22:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:19.234338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb853ae-6a37-457d-9e9c-b0aefe23a134 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:19.235096 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb853ae-6a37-457d-9e9c-b0aefe23a134 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:19.235305 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb853ae-6a37-457d-9e9c-b0aefe23a134 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:19.238862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 315/645] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:19.248279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0fb5-f576-4355-87da-2014d079be90 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:19.250170 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0fb5-f576-4355-87da-2014d079be90 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:19.250948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0fb5-f576-4355-87da-2014d079be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:19.265355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:19.292583 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-07de0fb5-f576-4355-87da-2014d079be90 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:19.294118 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-07de0fb5-f576-4355-87da-2014d079be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:19.394463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63e694-1d15-4997-9d4e-a7ec5ee19b36 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:19.395405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63e694-1d15-4997-9d4e-a7ec5ee19b36 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:19.397149 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 331/646] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:19.400677 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63e694-1d15-4997-9d4e-a7ec5ee19b36 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:19.400677 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 316/647] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:19.407748 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438104-cd5d-4557-bc2b-8dd271be1ba3 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:19.408060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438104-cd5d-4557-bc2b-8dd271be1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:19.408381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438104-cd5d-4557-bc2b-8dd271be1ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:19.432684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ab438104-cd5d-4557-bc2b-8dd271be1ba3 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:19.433986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ab438104-cd5d-4557-bc2b-8dd271be1ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:19.441346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63e694-1d15-4997-9d4e-a7ec5ee19b36 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:19.609492 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 332/648] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:22:19.638973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438104-cd5d-4557-bc2b-8dd271be1ba3 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:19.646055 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63e694-1d15-4997-9d4e-a7ec5ee19b36 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:19.715292 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:19.716378 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:19.716870 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:19.717525 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] PATH_INFO: `/v3/services/image` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:19.718742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:19.721535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:19.732225 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:19.748313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:19.749862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:19.750830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:19.751617 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 317/649] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Jul 25 20:22:19 2022] GET /identity/v3/services/image => generated 86 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:19.757848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:19.802379 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438104-cd5d-4557-bc2b-8dd271be1ba3 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:19.856624 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83dd7d-ee64-4fa0-a123-f1d7d9131d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:19.858101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83dd7d-ee64-4fa0-a123-f1d7d9131d0b None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:19.858914 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83dd7d-ee64-4fa0-a123-f1d7d9131d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:19.859689 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83dd7d-ee64-4fa0-a123-f1d7d9131d0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:19.874483 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83dd7d-ee64-4fa0-a123-f1d7d9131d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-2f83dd7d-ee64-4fa0-a123-f1d7d9131d0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:19.881706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:19.883846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:22:19.884701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:19.893668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 333/650] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:19.895737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83dd7d-ee64-4fa0-a123-f1d7d9131d0b None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:19.904807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:19.990263 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28981c-aafd-4622-b0d7-125daa1421d7 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:20.047724 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83dd7d-ee64-4fa0-a123-f1d7d9131d0b None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:20.077209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:20.078815 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:20.079719 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:20.080507 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:20.082190 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:20.083139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:20.086971 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:20.092393 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:20.101180 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 318/651] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:20.112134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:20.112863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:20.113241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:20.113540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:20.114361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:20.114673 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:20.114829 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:20.116519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:20.134278 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 334/652] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:22:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:20.135633 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:20.300204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb48fa-90bd-4af0-8762-c1a5e3c7c4f0 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:20.331927 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a067a-61d9-4b9a-949d-8f921ed87381 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:20.344197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:20.361763 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:20.362398 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:20.362962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:20.363520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:20.364993 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:20.365618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:20.369043 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:20.381232 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 319/653] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:20.432722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eae12-864b-4532-9741-773323c677c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:20.434298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eae12-864b-4532-9741-773323c677c5 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:20.434985 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eae12-864b-4532-9741-773323c677c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:20.435642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eae12-864b-4532-9741-773323c677c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:20.459890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eae12-864b-4532-9741-773323c677c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:20.464008 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eae12-864b-4532-9741-773323c677c5 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-bf6eae12-864b-4532-9741-773323c677c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:20.495902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:20.497207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:20.498427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:20.498427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:20.498427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:20.498427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:20.500534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 335/654] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:20.507693 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:20.525876 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1798776-6f71-48bb-a07c-c85e8f5a399c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:20.526394 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1798776-6f71-48bb-a07c-c85e8f5a399c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:20.526909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1798776-6f71-48bb-a07c-c85e8f5a399c None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:20.529986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 336/655] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:20.539153 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0aea4-206c-46ee-8d4a-b392ce5edace None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:20.540224 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0aea4-206c-46ee-8d4a-b392ce5edace None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:20.540751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0aea4-206c-46ee-8d4a-b392ce5edace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:20.575123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-e6e0aea4-206c-46ee-8d4a-b392ce5edace None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:20.577440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-e6e0aea4-206c-46ee-8d4a-b392ce5edace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:20.621441 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:20.679665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e9ab-4ff9-4ad8-89d9-b7689dd914b0 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:20.679955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 337/656] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:22:20.724957 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0aea4-206c-46ee-8d4a-b392ce5edace None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:20.730727 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:20.731679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:20.731995 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:20.732346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:20.733092 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:20.733434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:20.735057 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:20.751158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 320/657] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:20.756834 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:20.840805 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:20.920432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cd6ee-635c-4989-ae5c-4e565a9ce29a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:20.976659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0aea4-206c-46ee-8d4a-b392ce5edace None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:20.981465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:20.983458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:20.983930 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:20.984316 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:20.995552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:20.998146 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:21.025000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:21.028222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:21.030742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 321/658] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 20:22:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:21.033039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:21.076649 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:21.079128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:21.080144 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:21.081389 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] PATH_INFO: `/v3/services/network` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:21.082794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:21.087103 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:21.115409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:21.125366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:21.127111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 338/659] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:20 2022] GET /identity/v3/services/network => generated 88 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:21.134589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:21.204341 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:21.240751 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21086-77c8-42fd-b52f-2ff6c139170d None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:21.268967 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:21.313127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480689f-97aa-4ad0-b384-5102cf0cac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:21.314059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480689f-97aa-4ad0-b384-5102cf0cac32 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:21.314179 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480689f-97aa-4ad0-b384-5102cf0cac32 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:21.315033 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480689f-97aa-4ad0-b384-5102cf0cac32 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:21.315384 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480689f-97aa-4ad0-b384-5102cf0cac32 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:21.315878 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480689f-97aa-4ad0-b384-5102cf0cac32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:21.318421 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480689f-97aa-4ad0-b384-5102cf0cac32 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:21.330984 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541313-b6bb-4c5b-b4d8-13e32c624ac8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:21.357168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 322/660] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 20:22:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:21.357168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b89e-28b7-43e8-abc7-f9dffad992b2 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:21.357168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b89e-28b7-43e8-abc7-f9dffad992b2 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:21.357168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b89e-28b7-43e8-abc7-f9dffad992b2 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:21.358172 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 323/661] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:21.365648 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b89e-28b7-43e8-abc7-f9dffad992b2 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:21.409803 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f7955-b1ab-4079-a978-cedf9a451bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:21.410852 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7955-b1ab-4079-a978-cedf9a451bbd None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:21.411233 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7955-b1ab-4079-a978-cedf9a451bbd None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:21.411675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7955-b1ab-4079-a978-cedf9a451bbd None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:21.412737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f7955-b1ab-4079-a978-cedf9a451bbd None admin] RBAC: Adding query filter params (name=network) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:21.413262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f7955-b1ab-4079-a978-cedf9a451bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:21.416330 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f7955-b1ab-4079-a978-cedf9a451bbd None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:21.429167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 339/662] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:22:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:21.429167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26509d48-5f69-4c89-8bbd-6eb2dea50968 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:21.429167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26509d48-5f69-4c89-8bbd-6eb2dea50968 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:21.429167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26509d48-5f69-4c89-8bbd-6eb2dea50968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:21.468389 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-26509d48-5f69-4c89-8bbd-6eb2dea50968 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:21.470550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-26509d48-5f69-4c89-8bbd-6eb2dea50968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:21.614804 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 340/663] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:21.616554 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26509d48-5f69-4c89-8bbd-6eb2dea50968 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:21.636649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b89e-28b7-43e8-abc7-f9dffad992b2 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:21.672805 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:21.706076 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dcd1f-e3c9-4bc7-a241-ddcd5b90b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:21.707088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcd1f-e3c9-4bc7-a241-ddcd5b90b54e None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:21.707529 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcd1f-e3c9-4bc7-a241-ddcd5b90b54e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:21.707965 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcd1f-e3c9-4bc7-a241-ddcd5b90b54e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:21.782285 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:21.824060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26509d48-5f69-4c89-8bbd-6eb2dea50968 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:21.838355 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dcd1f-e3c9-4bc7-a241-ddcd5b90b54e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:21.840898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dcd1f-e3c9-4bc7-a241-ddcd5b90b54e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:21.886719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:21.887538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:21.887934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:21.888344 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:21.889222 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] RBAC: Adding query filter params (type=network) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:21.889734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:21.891574 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:21.898946 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 341/664] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:22:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:21.901465 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:22.084599 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 324/665] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:22:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:22.090692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dcd1f-e3c9-4bc7-a241-ddcd5b90b54e None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:22.134956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:22.155870 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5422e-48c6-4a82-a9aa-83b0a6309a66 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:22.227015 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c849b-094f-4ce7-9fb9-759a6c10d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:22.229311 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c849b-094f-4ce7-9fb9-759a6c10d69e None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:22.230026 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c849b-094f-4ce7-9fb9-759a6c10d69e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:22.230679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c849b-094f-4ce7-9fb9-759a6c10d69e None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:22.232041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c849b-094f-4ce7-9fb9-759a6c10d69e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:22.234087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c849b-094f-4ce7-9fb9-759a6c10d69e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:22.258772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 342/666] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:22:21 2022] POST /identity/v3/services => generated 251 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:22:22.269205 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:22.341943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dcd1f-e3c9-4bc7-a241-ddcd5b90b54e None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:22.407783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:22.408386 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:22.408667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:22.408947 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:22.422667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:22.424404 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:22.444097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:22.446458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:22.448495 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:22.448495 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:22.448495 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:22.448495 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:22.448495 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 325/667] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:22.456236 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c849b-094f-4ce7-9fb9-759a6c10d69e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:22.675930 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c849b-094f-4ce7-9fb9-759a6c10d69e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:22.724963 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:22.725646 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:22.725923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:22.726199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:22.727522 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:22.727875 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:22.729422 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:22.747623 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 343/668] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:22.753667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:22.887502 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5079fa-6336-4a63-87e7-a35861a5f45d None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:22.911913 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:22.938424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:22.939456 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:22.939952 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:22.940422 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:22.949768 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:22.951723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:22.966052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:22.967262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:22.968341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:22.968341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:22.968341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:22.968341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:22.968341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:22.968341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:22.968341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:22.968341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:22.971224 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 326/669] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:22.978415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:22.993955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:23.175400 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad0b4b-d016-4977-a130-49834a584afd None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:23.254951 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e324e-638e-4f82-b015-424661799111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:23.255944 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e324e-638e-4f82-b015-424661799111 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:23.256404 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e324e-638e-4f82-b015-424661799111 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:23.256868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e324e-638e-4f82-b015-424661799111 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:23.258925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e324e-638e-4f82-b015-424661799111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:23.259501 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e324e-638e-4f82-b015-424661799111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:23.262429 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e324e-638e-4f82-b015-424661799111 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:23.288794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 344/670] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:23.299676 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:23.528090 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad956b-0413-4616-8531-0618a7311e14 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:23.600226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eda6e2-30fa-48e2-b1a0-ae8f8ef37231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:23.601713 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eda6e2-30fa-48e2-b1a0-ae8f8ef37231 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:23.603033 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eda6e2-30fa-48e2-b1a0-ae8f8ef37231 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:23.603752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eda6e2-30fa-48e2-b1a0-ae8f8ef37231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:23.605573 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eda6e2-30fa-48e2-b1a0-ae8f8ef37231 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=3f1ec071cc544cad97e00695b093c0ec) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:23.606371 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eda6e2-30fa-48e2-b1a0-ae8f8ef37231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:23.609716 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eda6e2-30fa-48e2-b1a0-ae8f8ef37231 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:23.622926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 327/671] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:22:23 2022] GET /identity/v3/role_assignments?user.id=3f1ec071cc544cad97e00695b093c0ec&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=671de95ce54744059ab540d90d3b40ce => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:23.743817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50b8b-f064-4517-b31d-c029eb96dad9 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:23.745561 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50b8b-f064-4517-b31d-c029eb96dad9 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:23.746646 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50b8b-f064-4517-b31d-c029eb96dad9 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:23.751830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 345/672] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:23.760649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9645-fdbc-4e3e-aee9-3ff49a68cf40 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:23.761717 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9645-fdbc-4e3e-aee9-3ff49a68cf40 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:23.762617 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da9645-fdbc-4e3e-aee9-3ff49a68cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:23.797532 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-e4da9645-fdbc-4e3e-aee9-3ff49a68cf40 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:23.800275 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-e4da9645-fdbc-4e3e-aee9-3ff49a68cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:23.882544 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:23.951561 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 328/673] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:23.989205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda50b8b-f064-4517-b31d-c029eb96dad9 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:24.135783 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:24.204648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda50b8b-f064-4517-b31d-c029eb96dad9 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:24.278981 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4feb-b5ab-4f7c-a04e-79b001176764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:24.280068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4feb-b5ab-4f7c-a04e-79b001176764 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:24.280571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4feb-b5ab-4f7c-a04e-79b001176764 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:24.281074 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4feb-b5ab-4f7c-a04e-79b001176764 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:24.282498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b4feb-b5ab-4f7c-a04e-79b001176764 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:24.285164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b4feb-b5ab-4f7c-a04e-79b001176764 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:24.314887 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 346/674] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:22:23 2022] POST /identity/v3/services => generated 242 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:22:25.762695 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9dc0-71a0-4c0e-9113-361f71edc53d None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:25.763845 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9dc0-71a0-4c0e-9113-361f71edc53d None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:25.764488 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9dc0-71a0-4c0e-9113-361f71edc53d None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:25.767193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 329/675] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:25.776597 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3b1d4-bb88-42e0-83d4-94b992550300 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:25.777974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3b1d4-bb88-42e0-83d4-94b992550300 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:25.778549 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3b1d4-bb88-42e0-83d4-94b992550300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:25.824442 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-18f3b1d4-bb88-42e0-83d4-94b992550300 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:25.827777 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-18f3b1d4-bb88-42e0-83d4-94b992550300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:26.016438 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 347/676] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:25 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:26.068310 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d9dc0-71a0-4c0e-9113-361f71edc53d None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:26.080231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d129580-43eb-4918-8496-50897c50e8bc None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:26.081346 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d129580-43eb-4918-8496-50897c50e8bc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:26.082093 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d129580-43eb-4918-8496-50897c50e8bc None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:26.085496 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 348/677] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:26.096359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71d0e-72b0-4041-9136-2a76e9626570 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:26.097086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71d0e-72b0-4041-9136-2a76e9626570 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:26.097855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71d0e-72b0-4041-9136-2a76e9626570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:26.129263 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-84b71d0e-72b0-4041-9136-2a76e9626570 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:26.130909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-84b71d0e-72b0-4041-9136-2a76e9626570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:26.219560 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:26.257722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 349/678] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:26 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 20:22:26.287123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71d0e-72b0-4041-9136-2a76e9626570 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:26.320972 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d9dc0-71a0-4c0e-9113-361f71edc53d None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:26.384038 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe394-3337-4c67-b070-7eec39fe1cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:26.385304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe394-3337-4c67-b070-7eec39fe1cdb None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:26.386266 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe394-3337-4c67-b070-7eec39fe1cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:26.387247 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe394-3337-4c67-b070-7eec39fe1cdb None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:26.388804 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fe394-3337-4c67-b070-7eec39fe1cdb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:26.392245 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fe394-3337-4c67-b070-7eec39fe1cdb None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:26.441196 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 330/679] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:22:26 2022] POST /identity/v3/services => generated 240 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:22:26.517630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71d0e-72b0-4041-9136-2a76e9626570 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:26.604959 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:26.606073 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:26.606566 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:26.607068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:26.608269 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:26.611115 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:26.630743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:26.631857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:26.632704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:26.633585 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 350/680] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Jul 25 20:22:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:26.641615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe394-3337-4c67-b070-7eec39fe1cdb None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:26.708946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:26.851033 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe394-3337-4c67-b070-7eec39fe1cdb None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:26.913797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:26.915446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:26.915954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:26.916607 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:26.918176 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:26.918925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:26.921598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:26.929884 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 331/681] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 20:22:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:26.939397 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:27.020211 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:27.141495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823e30-f462-4734-85c6-9a20bd0bfc94 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:27.215883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b6313-e5ee-4226-bc6e-58272e8e848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:27.216830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6313-e5ee-4226-bc6e-58272e8e848f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:27.217706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6313-e5ee-4226-bc6e-58272e8e848f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:27.218199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6313-e5ee-4226-bc6e-58272e8e848f None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:27.219515 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b6313-e5ee-4226-bc6e-58272e8e848f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:27.220046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b6313-e5ee-4226-bc6e-58272e8e848f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:27.223090 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b6313-e5ee-4226-bc6e-58272e8e848f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:27.235455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 351/682] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 20:22:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:27.244725 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:27.438996 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a119c7-deef-4a77-a7b5-87788745544f None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:27.440298 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:27.441594 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a119c7-deef-4a77-a7b5-87788745544f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:27.442423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a119c7-deef-4a77-a7b5-87788745544f None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:27.447759 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151810a-d967-4fa3-aff9-b371d6cf0b66 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:27.448615 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 352/683] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:27.457898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e336-1111-4f3e-9ee0-37f4ee59ee28 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:27.458857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e336-1111-4f3e-9ee0-37f4ee59ee28 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:27.459593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e336-1111-4f3e-9ee0-37f4ee59ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:27.491666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-3890e336-1111-4f3e-9ee0-37f4ee59ee28 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:27.495599 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-3890e336-1111-4f3e-9ee0-37f4ee59ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:27.495871 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:27.496576 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:27.496861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:27.497178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:27.498111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] RBAC: Adding query filter params (interface=public, service_id=ec76bc6327ea4b86bcac32c55f59d226, region_id=RegionOne) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:27.498429 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:27.500072 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:27.509978 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 332/684] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 20:22:27 2022] GET /identity/v3/endpoints?service_id=ec76bc6327ea4b86bcac32c55f59d226&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:27.522008 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:27.645427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 353/685] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 20:22:27.682862 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890e336-1111-4f3e-9ee0-37f4ee59ee28 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:27.701670 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2daaf5-31ea-4933-bdd2-4bead666123e None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:27.768178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927499-0b36-4ecd-83d1-9a129b30bd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:27.769095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927499-0b36-4ecd-83d1-9a129b30bd4b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:27.769593 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927499-0b36-4ecd-83d1-9a129b30bd4b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:27.770029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927499-0b36-4ecd-83d1-9a129b30bd4b None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:27.771137 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927499-0b36-4ecd-83d1-9a129b30bd4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:27.773513 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:27.775569 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927499-0b36-4ecd-83d1-9a129b30bd4b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:27.788814 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 333/686] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 20:22:27 2022] GET /identity/v3/services => generated 1002 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:22:27.904553 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890e336-1111-4f3e-9ee0-37f4ee59ee28 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:27.979473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0240ff-03aa-46d7-9ebe-45eb1c852fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:27.980689 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0240ff-03aa-46d7-9ebe-45eb1c852fa4 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:27.981233 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0240ff-03aa-46d7-9ebe-45eb1c852fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:27.981740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0240ff-03aa-46d7-9ebe-45eb1c852fa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:28.005292 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0240ff-03aa-46d7-9ebe-45eb1c852fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-6d0240ff-03aa-46d7-9ebe-45eb1c852fa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:28.016359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:28.018038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:22:28.019591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:28.025234 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 354/687] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:22:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:28.029543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927499-0b36-4ecd-83d1-9a129b30bd4b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:28.102939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:28.270901 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927499-0b36-4ecd-83d1-9a129b30bd4b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:28.310194 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea2c3f-c581-4e0d-854a-2bf87d00cbdd None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:28.311021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea2c3f-c581-4e0d-854a-2bf87d00cbdd None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:28.311785 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea2c3f-c581-4e0d-854a-2bf87d00cbdd None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:28.321695 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 355/688] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:28.326189 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29f63-0113-4b80-9815-67a2df0efdbb None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:28.327123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29f63-0113-4b80-9815-67a2df0efdbb None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:28.327856 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29f63-0113-4b80-9815-67a2df0efdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:28.356277 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:28.357415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:28.357922 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:28.358420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:28.359842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:28.361422 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:28.364629 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:28.369751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-55c29f63-0113-4b80-9815-67a2df0efdbb None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:28.371910 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-55c29f63-0113-4b80-9815-67a2df0efdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:28.389244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 334/689] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:28.395220 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:28.521212 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 356/690] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:28 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 20:22:28.552471 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:28.563309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29f63-0113-4b80-9815-67a2df0efdbb None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:28.578728 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16ce9-e3bf-4e5e-b0cf-9710f4380653 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:28.622755 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:28.630447 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:28.631132 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:28.631414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:28.631723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:28.654407 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:28.657256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:28.688226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:28.690370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:28.692046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:28.692046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:28.692046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:28.692046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:28.697122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 335/691] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:28.699042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:28.784737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29f63-0113-4b80-9815-67a2df0efdbb None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:28.855371 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15af70-9969-4d37-813b-65b5f6fd59c4 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:28.861319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:28.862973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:28.863911 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:28.864736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] PATH_INFO: `/v3/services/image` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:28.867066 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:28.870900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:28.891197 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:28.893207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:28.894907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:28.908245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 357/692] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Jul 25 20:22:28 2022] GET /identity/v3/services/image => generated 86 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:28.910241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:28.910463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:28.911084 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:28.911367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:28.911662 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:28.912520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:28.912829 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:28.915306 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:28.933856 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:28.937459 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 336/693] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:28.942682 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:29.134100 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:29.151763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9dd4-0159-4667-9995-989a835769c8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:29.161426 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0727-01a3-4ea7-a5b2-91c7b0b18f96 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:29.236746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:29.238518 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:29.239376 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:29.240191 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:29.241326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:29.242089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] RBAC: Adding query filter params (name=image) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:29.242389 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:29.243427 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:29.243963 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:29.244713 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:29.248547 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:29.256120 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:29.258899 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:29.266045 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 358/694] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:29.274686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:29.283396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:29.285487 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:29.287776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 337/695] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 20:22:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:29.294875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:29.427822 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:29.520085 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059704f-4256-4d6e-89c9-a732f90822fa None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:29.540707 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505424e-d295-4a91-9dc8-be8b5904361c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:29.602776 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:29.603623 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:29.603948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:29.604226 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:29.604939 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] RBAC: Adding query filter params (type=image) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:29.605310 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:29.605561 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:29.606869 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:29.607137 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:29.607927 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:29.609396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:29.612618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:29.613509 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:29.614334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 359/696] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:29.616901 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:29.629218 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:29.664946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 338/697] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 20:22:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:29.671482 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:29.674417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:29.858445 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b2ae-af13-4ca7-b05d-28e806e5c5fd None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:29.886603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53011a0-b209-487d-9ead-4cdf083a7247 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:29.931201 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:29.940752 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:29.942398 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:29.943164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:29.943899 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:29.946409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] RBAC: Adding query filter params (interface=public, service_id=8a68642f4a434c66b39e7b0aee71cda5, region_id=RegionOne) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:29.947272 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:29.950497 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:29.973260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:29.973260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:29.973260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:29.973260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:29.973920 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 360/698] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 20:22:29 2022] GET /identity/v3/endpoints?service_id=8a68642f4a434c66b39e7b0aee71cda5&interface=public®ion_id=RegionOne => generated 194 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:29.975170 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:29.991023 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:29.994102 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:30.024198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:30.025954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:30.027660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:30.027660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:30.027660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:30.027660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:30.027660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 339/699] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:30.045182 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:30.174107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:30.209558 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73742b03-7ced-4e92-b885-937d605c5526 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:30.281351 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1538f6-66cf-4d27-8f96-3bad9a6e7d33 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:30.293668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6d337-a717-4206-9414-4d2729eee4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:30.295250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6d337-a717-4206-9414-4d2729eee4aa None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:30.296904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6d337-a717-4206-9414-4d2729eee4aa None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:30.297822 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6d337-a717-4206-9414-4d2729eee4aa None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:30.299379 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6d337-a717-4206-9414-4d2729eee4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:30.304027 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6d337-a717-4206-9414-4d2729eee4aa None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:30.317012 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 361/700] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 20:22:29 2022] GET /identity/v3/services => generated 1002 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:22:30.319904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b933f0-6ab3-4ec3-84e8-55dac8f05364 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:30.320593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b933f0-6ab3-4ec3-84e8-55dac8f05364 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:30.321085 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b933f0-6ab3-4ec3-84e8-55dac8f05364 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:30.324381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 362/701] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:30.334634 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e372-2cea-4b0c-a4e2-7e0da47d4afe None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:30.335112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e372-2cea-4b0c-a4e2-7e0da47d4afe None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:30.335733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e372-2cea-4b0c-a4e2-7e0da47d4afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:30.362017 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:30.364560 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:30.365387 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:30.366095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:30.369970 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:30.370931 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:30.373911 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:30.375258 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-1236e372-2cea-4b0c-a4e2-7e0da47d4afe None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:30.378052 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-1236e372-2cea-4b0c-a4e2-7e0da47d4afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:30.411781 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 340/702] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:30.422716 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:30.492241 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:30.545951 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 363/703] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:30.582642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236e372-2cea-4b0c-a4e2-7e0da47d4afe None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:30.687760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7160-180b-4f33-8526-54a11e4739d5 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:30.771078 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:30.772610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:30.773419 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:30.775548 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:30.790956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:30.794355 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:30.797192 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:30.820028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:30.823113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:30.824886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:30.824886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:30.824886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:30.824886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:30.824886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:30.824886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:30.824886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:30.824886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:30.834963 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236e372-2cea-4b0c-a4e2-7e0da47d4afe None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:30.835868 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 341/704] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:30.842408 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:30.912595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:30.913780 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:30.914510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:30.916791 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] PATH_INFO: `/v3/services/network` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:30.916791 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:30.918679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:30.938992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:30.941060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:30.943849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:30.948753 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 364/705] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:30 2022] GET /identity/v3/services/network => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:30.953200 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:31.066437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:31.095504 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eed3f-cb8a-4d87-b17f-db8be6018612 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:31.174240 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:31.175751 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:31.176603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:31.177732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:31.179478 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:31.181349 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:31.184591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:31.189025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faacb2-67b6-4dd9-8160-ee5ce41db47d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:31.221294 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 342/706] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:31.224017 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:31.247459 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe13d3-2469-495f-8e98-90731f1a1a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:31.248620 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe13d3-2469-495f-8e98-90731f1a1a8e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:31.249356 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe13d3-2469-495f-8e98-90731f1a1a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:31.249830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe13d3-2469-495f-8e98-90731f1a1a8e None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:31.250988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe13d3-2469-495f-8e98-90731f1a1a8e None admin] RBAC: Adding query filter params (name=network) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:31.251688 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe13d3-2469-495f-8e98-90731f1a1a8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:31.253840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe13d3-2469-495f-8e98-90731f1a1a8e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:31.262158 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 365/707] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:22:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:31.264811 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0ef7-fe78-47ba-83bf-1870d9086534 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:31.265353 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0ef7-fe78-47ba-83bf-1870d9086534 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:31.265818 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0ef7-fe78-47ba-83bf-1870d9086534 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:31.267449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 366/708] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:31.272579 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a0ef7-fe78-47ba-83bf-1870d9086534 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:31.287213 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:31.437667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdf61d-dd20-4fb0-b8f3-c9ccab229618 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:31.486058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a0ef7-fe78-47ba-83bf-1870d9086534 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:31.513753 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37696f58-1b08-47f7-8bca-2f555c970bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:31.514837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696f58-1b08-47f7-8bca-2f555c970bc6 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:31.515307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696f58-1b08-47f7-8bca-2f555c970bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:31.515791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696f58-1b08-47f7-8bca-2f555c970bc6 None admin] PATH_INFO: `/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/3f1ec071cc544cad97e00695b093c0ec/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:31.519479 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37696f58-1b08-47f7-8bca-2f555c970bc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcba1bed6cbb44dd8da5613751435133, user_id=3f1ec071cc544cad97e00695b093c0ec, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:31.522281 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37696f58-1b08-47f7-8bca-2f555c970bc6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:31.546944 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 343/709] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:22:31 2022] PUT /identity/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/3f1ec071cc544cad97e00695b093c0ec/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:22:31.550010 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6340-6840-4b14-b7ff-ad15736a714f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:31.550944 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6340-6840-4b14-b7ff-ad15736a714f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:31.551676 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6340-6840-4b14-b7ff-ad15736a714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:31.576256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:31.577511 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:31.578034 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:31.578710 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:31.580544 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] RBAC: Adding query filter params (type=network) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:31.581265 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:31.583777 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:31.587763 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-90fe6340-6840-4b14-b7ff-ad15736a714f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:31.590483 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-90fe6340-6840-4b14-b7ff-ad15736a714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:31.595125 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:31.597070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 367/710] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:22:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:31.606061 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:31.753406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 344/711] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:31.774374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:31.795827 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe6340-6840-4b14-b7ff-ad15736a714f None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:31.844912 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9c924-a81d-49c0-b13c-baa7aaaa9223 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:31.933368 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:31.934842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:31.935360 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:31.935852 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:31.936772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] RBAC: Adding query filter params (interface=public, service_id=efbbbb1f8d104e14acdcb2ed6f1ca4fd, region_id=RegionOne) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:31.937155 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:31.939745 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:31.952273 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 368/712] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 20:22:31 2022] GET /identity/v3/endpoints?service_id=efbbbb1f8d104e14acdcb2ed6f1ca4fd&interface=public®ion_id=RegionOne => generated 194 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:31.963632 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:32.032964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe6340-6840-4b14-b7ff-ad15736a714f None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:32.128957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:32.130375 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:32.130934 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:32.131527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:32.132982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:32.136119 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:32.156816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:32.158767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 20:22:32.160336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:32.165986 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 345/713] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Jul 25 20:22:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:32.170848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:32.176183 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:32.230650 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541182d-b472-46bc-9c56-9a6c82807ee8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:32.313327 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21ea24-fe72-445f-b96f-55ddbddadcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:32.314141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ea24-fe72-445f-b96f-55ddbddadcc9 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:32.314516 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ea24-fe72-445f-b96f-55ddbddadcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:32.314845 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ea24-fe72-445f-b96f-55ddbddadcc9 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:32.315597 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21ea24-fe72-445f-b96f-55ddbddadcc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:32.317614 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21ea24-fe72-445f-b96f-55ddbddadcc9 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:32.320923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:32.331486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 369/714] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 20:22:31 2022] GET /identity/v3/services => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:22:32.410872 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7da913-a8db-4ce1-89c4-bfdcf9591050 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:32.488464 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:32.490798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:32.491592 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:32.492348 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:32.494861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:32.495697 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:32.499667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:32.511623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 346/715] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 20:22:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:32.520285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21ea24-fe72-445f-b96f-55ddbddadcc9 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:32.745753 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21ea24-fe72-445f-b96f-55ddbddadcc9 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:32.814111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066922d-94cd-4d39-9e22-a1b8decee69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:32.814841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066922d-94cd-4d39-9e22-a1b8decee69e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:32.815303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066922d-94cd-4d39-9e22-a1b8decee69e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:32.815769 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066922d-94cd-4d39-9e22-a1b8decee69e None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:32.816902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066922d-94cd-4d39-9e22-a1b8decee69e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:32.817238 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066922d-94cd-4d39-9e22-a1b8decee69e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:32.819863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066922d-94cd-4d39-9e22-a1b8decee69e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:32.845052 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 370/716] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 20:22:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:32.858971 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:33.012345 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:33.105798 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f9b7-b8e4-4b3d-ad70-497dce2f939f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:33.176432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2b961-7680-493b-91f6-1e55e427667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:33.178432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b961-7680-493b-91f6-1e55e427667e None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:33.179402 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b961-7680-493b-91f6-1e55e427667e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:33.180256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b961-7680-493b-91f6-1e55e427667e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:33.182055 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2b961-7680-493b-91f6-1e55e427667e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:33.185095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2b961-7680-493b-91f6-1e55e427667e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:33.235130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 347/717] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:22:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:22:34.465517 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2063f-c21a-4048-a1bf-34c129a7c078 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:34.466315 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2063f-c21a-4048-a1bf-34c129a7c078 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:34.466462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2063f-c21a-4048-a1bf-34c129a7c078 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:34.469505 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 371/718] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:34.479581 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1925c5-2685-4cfc-ac30-364fce8fafd4 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:34.480400 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1925c5-2685-4cfc-ac30-364fce8fafd4 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:34.480580 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1925c5-2685-4cfc-ac30-364fce8fafd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:34.515254 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-ed1925c5-2685-4cfc-ac30-364fce8fafd4 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:34.517474 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ed1925c5-2685-4cfc-ac30-364fce8fafd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:34.679269 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 348/719] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:34.721412 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2063f-c21a-4048-a1bf-34c129a7c078 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:34.869874 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:34.947595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2063f-c21a-4048-a1bf-34c129a7c078 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:35.019662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:35.020662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:35.021204 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:35.021678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] PATH_INFO: `/v3/services/image` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:35.022840 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:35.026177 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:35.053728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:35.056303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 20:22:35.059415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:35.066221 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 372/720] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Jul 25 20:22:34 2022] GET /identity/v3/services/image => generated 86 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:35.076431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1925c5-2685-4cfc-ac30-364fce8fafd4 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:35.183327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:35.295581 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1925c5-2685-4cfc-ac30-364fce8fafd4 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:35.382200 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0fe0f-2bc1-4b31-a9b0-76d80bd61d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:35.383111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0fe0f-2bc1-4b31-a9b0-76d80bd61d33 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:35.383641 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0fe0f-2bc1-4b31-a9b0-76d80bd61d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:35.384145 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0fe0f-2bc1-4b31-a9b0-76d80bd61d33 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:35.385613 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0fe0f-2bc1-4b31-a9b0-76d80bd61d33 None admin] RBAC: Adding query filter params (name=image) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:35.386177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0fe0f-2bc1-4b31-a9b0-76d80bd61d33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:35.389036 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0fe0f-2bc1-4b31-a9b0-76d80bd61d33 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:35.400186 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 349/721] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:35.409202 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:35.647224 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e6827-5ef5-4dba-864e-25dc9b0128e7 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:35.661676 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656e2c1-c664-4e5b-90cf-3d4cbd07844b None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:35.663283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656e2c1-c664-4e5b-90cf-3d4cbd07844b None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:35.664123 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656e2c1-c664-4e5b-90cf-3d4cbd07844b None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:35.675220 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 350/722] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:35 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:22:35.678406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253748b-93b3-40bb-ae00-d072b534140b None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:35.679396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253748b-93b3-40bb-ae00-d072b534140b None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:35.680827 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253748b-93b3-40bb-ae00-d072b534140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:35.714932 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:35.719289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-8253748b-93b3-40bb-ae00-d072b534140b None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:35.722238 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-8253748b-93b3-40bb-ae00-d072b534140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:35.731412 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:35.732320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:35.732753 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:35.733232 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:35.734517 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] RBAC: Adding query filter params (type=image) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:35.735069 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:35.737629 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:35.749652 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 373/723] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:35.759497 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:35.893660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 351/724] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:35 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 20:22:35.933050 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253748b-93b3-40bb-ae00-d072b534140b None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:36.014321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b3d1d-89b9-4235-9f1a-4862ebf27fdd None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:36.037992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:36.101620 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c873-5ea8-460b-8035-ce93cae1d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:36.103305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c873-5ea8-460b-8035-ce93cae1d4ba None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:36.104015 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c873-5ea8-460b-8035-ce93cae1d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:36.104535 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c873-5ea8-460b-8035-ce93cae1d4ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:36.105953 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c873-5ea8-460b-8035-ce93cae1d4ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:36.108993 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c873-5ea8-460b-8035-ce93cae1d4ba None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:36.164345 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 374/725] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:22:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:22:36.190291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253748b-93b3-40bb-ae00-d072b534140b None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:36.298205 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3049-eb83-4486-af74-ab7ee7dc3b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:36.300014 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3049-eb83-4486-af74-ab7ee7dc3b41 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:36.300799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3049-eb83-4486-af74-ab7ee7dc3b41 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:36.301555 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3049-eb83-4486-af74-ab7ee7dc3b41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:36.326838 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c3049-eb83-4486-af74-ab7ee7dc3b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-cc1c3049-eb83-4486-af74-ab7ee7dc3b41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:22:36.338127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:36.340257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:22:36.342374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:36.346301 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 352/726] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:22:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:36.365876 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c873-5ea8-460b-8035-ce93cae1d4ba None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:36.479288 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:36.587533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b5f5-d431-421e-9dbe-57f8c7ba1ad4 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:36.588273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b5f5-d431-421e-9dbe-57f8c7ba1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:36.588750 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b5f5-d431-421e-9dbe-57f8c7ba1ad4 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:36.591610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 353/727] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:22:36.601898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d6088-2af0-4dc2-9f0a-3b9216bb283e None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:36.603217 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d6088-2af0-4dc2-9f0a-3b9216bb283e None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:36.603600 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d6088-2af0-4dc2-9f0a-3b9216bb283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:36.605453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c873-5ea8-460b-8035-ce93cae1d4ba None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:36.638541 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-628d6088-2af0-4dc2-9f0a-3b9216bb283e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:36.640719 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-628d6088-2af0-4dc2-9f0a-3b9216bb283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:36.686378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:36.687512 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:36.687976 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:36.688452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:36.689962 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:36.690514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:36.694544 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:36.714994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 375/728] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:36.724622 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:36.814052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 354/729] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:36 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 20:22:36.857423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d6088-2af0-4dc2-9f0a-3b9216bb283e None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:36.926583 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:36.962811 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc2624-ea77-4a6f-bd2e-24cf97b5cd85 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:36.989751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:37.059879 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:37.060874 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:37.061489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:37.062055 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:37.087282 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:37.090578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:37.124825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:37.126727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:37.128685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:37.128685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:37.128685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:37.128685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:37.132976 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 376/730] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:37.137206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:37.141211 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d6088-2af0-4dc2-9f0a-3b9216bb283e None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:37.229086 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:37.230800 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:37.231638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:37.232358 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] PATH_INFO: `/v3/services/network` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:37.234979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:37.239010 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:37.263644 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:37.265797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 20:22:37.267496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:37.277178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 355/731] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:36 2022] GET /identity/v3/services/network => generated 88 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:37.283508 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:37.411359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592032-4093-458b-b1b9-594ff9f873c7 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:37.497425 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8d555-bb3f-4e91-9662-4e3ce29fb36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:37.499288 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d555-bb3f-4e91-9662-4e3ce29fb36d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:37.500307 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d555-bb3f-4e91-9662-4e3ce29fb36d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:37.501154 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8d555-bb3f-4e91-9662-4e3ce29fb36d None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:37.502889 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8d555-bb3f-4e91-9662-4e3ce29fb36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:37.503972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8d555-bb3f-4e91-9662-4e3ce29fb36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:37.507542 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8d555-bb3f-4e91-9662-4e3ce29fb36d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:37.520372 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:37.535918 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 377/732] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:37.538712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f427f-4e20-49db-b026-cf060a5d5bfb None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:37.538957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4beb-129f-4205-97cf-682fb52f570c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:37.540403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f427f-4e20-49db-b026-cf060a5d5bfb None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:37.541275 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f427f-4e20-49db-b026-cf060a5d5bfb None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:37.544285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 378/733] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:37.546595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f427f-4e20-49db-b026-cf060a5d5bfb None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:37.596667 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:37.629035 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c57bf5-77a7-4824-a49e-c82003d0d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:37.630382 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c57bf5-77a7-4824-a49e-c82003d0d87c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:37.630858 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c57bf5-77a7-4824-a49e-c82003d0d87c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:37.631313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c57bf5-77a7-4824-a49e-c82003d0d87c None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:37.632528 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c57bf5-77a7-4824-a49e-c82003d0d87c None admin] RBAC: Adding query filter params (name=network) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:37.633042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c57bf5-77a7-4824-a49e-c82003d0d87c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:37.635563 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c57bf5-77a7-4824-a49e-c82003d0d87c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:37.645914 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 356/734] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:22:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:37.648301 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d5934-c830-4a0c-b1e9-9130364f3118 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:37.649609 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d5934-c830-4a0c-b1e9-9130364f3118 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:37.651041 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d5934-c830-4a0c-b1e9-9130364f3118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:37.686791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-ff3d5934-c830-4a0c-b1e9-9130364f3118 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:37.688738 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ff3d5934-c830-4a0c-b1e9-9130364f3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:37.778980 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f427f-4e20-49db-b026-cf060a5d5bfb None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:37.829420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 357/735] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:37 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:37.830707 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d5934-c830-4a0c-b1e9-9130364f3118 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:37.866503 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:37.867759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:37.868845 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:37.869491 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:37.885775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:37.888516 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:22:37.912510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:37.923525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 379/736] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 20:22:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:37.925348 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:38.057582 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:38.089973 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d5934-c830-4a0c-b1e9-9130364f3118 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:38.122548 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:38.165682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2300-d41e-42b4-b8b4-ea4c515273dc None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:38.169406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:38.171283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:38.171283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:38.171592 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:38.172895 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] RBAC: Adding query filter params (type=network) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:38.173511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:38.176039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:38.194098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 358/737] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:22:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:38.194098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:38.247295 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:38.248415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:38.248895 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:38.249446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:38.250564 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:38.253134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:38.271385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:38.274449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:38.276132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 380/738] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:38.279626 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:38.422648 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949835bf-1eee-43c4-9c95-ac2dc3d4f158 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:38.497160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96046af-871e-4753-be9c-a891a9665d25 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:38.497431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:38.498240 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:38.498677 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:38.499122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:38.500501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:38.500999 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:38.503492 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:38.538699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 359/739] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 20:22:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:38.540697 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:38.561243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:38.582538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a9f3b-3e35-4e5c-8139-95cc7a4b7791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:38.583512 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a9f3b-3e35-4e5c-8139-95cc7a4b7791 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:38.584000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a9f3b-3e35-4e5c-8139-95cc7a4b7791 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:38.584491 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a9f3b-3e35-4e5c-8139-95cc7a4b7791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:38.585988 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a9f3b-3e35-4e5c-8139-95cc7a4b7791 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:38.590253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a9f3b-3e35-4e5c-8139-95cc7a4b7791 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:38.630796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 381/740] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:22:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:22:38.632301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a9f3b-3e35-4e5c-8139-95cc7a4b7791 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:38.654778 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:38.801709 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e0aad-7004-45c6-923a-3d2698bb8014 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:38.887955 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:38.893144 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:38.893144 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:38.893144 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:38.893144 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:38.893144 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:38.894602 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:38.900759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a9f3b-3e35-4e5c-8139-95cc7a4b7791 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:38.913952 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 360/741] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:38.919648 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:38.983807 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18a022-51ba-4534-acfc-ecf12edc5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:38.985946 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18a022-51ba-4534-acfc-ecf12edc5f5a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:38.986497 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18a022-51ba-4534-acfc-ecf12edc5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:38.987404 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18a022-51ba-4534-acfc-ecf12edc5f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:39.090603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:39.171099 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18a022-51ba-4534-acfc-ecf12edc5f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:39.174038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18a022-51ba-4534-acfc-ecf12edc5f5a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:39.175465 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892251a2-c540-4e75-85e6-539b603976e1 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:39.178208 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:39.257457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:39.259178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:39.259597 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:39.260095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:39.261454 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:39.261983 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:39.264601 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:39.273290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 361/742] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:39.334384 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 382/743] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:22:38 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 20:22:39.342489 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:39.580271 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608248-20a3-49a1-949e-600d6ee76ba3 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:39.642181 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:39.652606 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:39.653728 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:39.654218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:39.654737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:39.676506 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:39.679550 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:39.710655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:39.713022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:39.714821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:39.714821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:39.714821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:39.714821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:39.714821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 362/744] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:39.725838 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18a022-51ba-4534-acfc-ecf12edc5f5a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:39.956372 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18a022-51ba-4534-acfc-ecf12edc5f5a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:39.959467 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:40.032728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:40.034008 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:40.034499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:40.034945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:40.037471 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:40.037471 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:40.040148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:40.065482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 383/745] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:40.066073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:40.211437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783bc90-3241-4f5a-880f-afdaaa700c7d None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:40.260223 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202d41a-82b6-4fc0-8220-93512345619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:40.261073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d41a-82b6-4fc0-8220-93512345619f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:40.261551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d41a-82b6-4fc0-8220-93512345619f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:40.261979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d41a-82b6-4fc0-8220-93512345619f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:40.271726 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202d41a-82b6-4fc0-8220-93512345619f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:40.273634 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202d41a-82b6-4fc0-8220-93512345619f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-5202d41a-82b6-4fc0-8220-93512345619f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:40.288091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:40.296772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:40.297739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 363/746] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:40.299874 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:40.468684 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff398e-d025-4b82-ab25-e96df4bbf623 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:40.469095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff398e-d025-4b82-ab25-e96df4bbf623 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:40.469639 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff398e-d025-4b82-ab25-e96df4bbf623 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:40.472336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 364/747] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:22:40.483164 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bd96-3a9c-44c2-891f-948174b74fac None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:40.483653 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bd96-3a9c-44c2-891f-948174b74fac None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:40.484158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2bd96-3a9c-44c2-891f-948174b74fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:40.504236 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1481e73-5fa9-4ef8-93d0-e032a46b7d38 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:40.519038 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-52d2bd96-3a9c-44c2-891f-948174b74fac None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:40.521268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-52d2bd96-3a9c-44c2-891f-948174b74fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:40.580002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:40.581199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:40.581701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:40.582187 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:40.583753 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:40.584314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:40.588772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:40.611238 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:40.615913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 384/748] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:22:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:40.626138 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:40.678317 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 365/749] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:40 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 20:22:40.678821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:40.719868 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2bd96-3a9c-44c2-891f-948174b74fac None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:40.858543 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad2f52-41c7-41e4-9bfc-1eae52eb708c None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:40.937565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2bd96-3a9c-44c2-891f-948174b74fac None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:40.939992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:40.941034 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:40.941544 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:40.942029 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:40.943548 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=3f1ec071cc544cad97e00695b093c0ec) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:40.944011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:40.946831 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:40.969141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 385/750] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:22:40 2022] GET /identity/v3/role_assignments?user.id=3f1ec071cc544cad97e00695b093c0ec&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=671de95ce54744059ab540d90d3b40ce => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:41.013909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce39190-6cc4-41bb-b6a0-59600ad554cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:41.014789 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce39190-6cc4-41bb-b6a0-59600ad554cf None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:41.015228 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce39190-6cc4-41bb-b6a0-59600ad554cf None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:41.015659 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce39190-6cc4-41bb-b6a0-59600ad554cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:41.125954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:41.187052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce39190-6cc4-41bb-b6a0-59600ad554cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:41.189958 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce39190-6cc4-41bb-b6a0-59600ad554cf None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:41.410123 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 366/751] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:22:40 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 20:22:41.420605 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:41.598522 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:41.632400 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771805d-43c5-4d67-a15e-154c50036240 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:41.705260 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd35851-b8aa-4dcf-a712-8682503a91e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:41.706250 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd35851-b8aa-4dcf-a712-8682503a91e6 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:41.706731 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd35851-b8aa-4dcf-a712-8682503a91e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:41.707239 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd35851-b8aa-4dcf-a712-8682503a91e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:41.730109 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd35851-b8aa-4dcf-a712-8682503a91e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:41.732648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd35851-b8aa-4dcf-a712-8682503a91e6 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-4fd35851-b8aa-4dcf-a712-8682503a91e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:22:41.761479 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:41.763285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:41.766053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:22:41.766053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:22:41.766053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:22:41.766053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:41.769226 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 386/752] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:41.771851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce39190-6cc4-41bb-b6a0-59600ad554cf None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:41.928625 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:41.987239 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce39190-6cc4-41bb-b6a0-59600ad554cf None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:42.062012 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794236e-5fdf-4322-9225-e7c161033b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:42.063659 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794236e-5fdf-4322-9225-e7c161033b10 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:42.064419 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794236e-5fdf-4322-9225-e7c161033b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:42.065455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794236e-5fdf-4322-9225-e7c161033b10 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:42.066904 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794236e-5fdf-4322-9225-e7c161033b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:42.067471 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794236e-5fdf-4322-9225-e7c161033b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:42.070266 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794236e-5fdf-4322-9225-e7c161033b10 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:42.098230 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 367/753] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:43.203567 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573903c-4925-46c5-b045-561cddb1e4e3 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:43.204410 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573903c-4925-46c5-b045-561cddb1e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:43.204560 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573903c-4925-46c5-b045-561cddb1e4e3 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:43.207246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 387/754] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:43.218094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6913d3-600c-4dc9-a206-5464a2c4ced2 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:43.218938 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6913d3-600c-4dc9-a206-5464a2c4ced2 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:43.219089 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6913d3-600c-4dc9-a206-5464a2c4ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:43.254970 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-2a6913d3-600c-4dc9-a206-5464a2c4ced2 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:43.257307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-2a6913d3-600c-4dc9-a206-5464a2c4ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:43.410078 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 368/755] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:43 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:43.455986 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573903c-4925-46c5-b045-561cddb1e4e3 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:43.683147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573903c-4925-46c5-b045-561cddb1e4e3 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:43.756124 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d986ff-af12-41cb-a224-027de4d10e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:43.757324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d986ff-af12-41cb-a224-027de4d10e5a None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:43.757789 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d986ff-af12-41cb-a224-027de4d10e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:43.758852 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d986ff-af12-41cb-a224-027de4d10e5a None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:43.760284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d986ff-af12-41cb-a224-027de4d10e5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:43.763296 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d986ff-af12-41cb-a224-027de4d10e5a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:43.780794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:43.796002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 388/756] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:22:43 2022] POST /identity/v3/services => generated 251 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:22:45.217621 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827449-1ef6-4693-9ebf-d0ba7b5c4a93 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:45.218478 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827449-1ef6-4693-9ebf-d0ba7b5c4a93 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:45.218478 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c827449-1ef6-4693-9ebf-d0ba7b5c4a93 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:45.220837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 369/757] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:45.230704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929c54-e07f-46cf-a19d-7db0471ca1cc None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:45.231553 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929c54-e07f-46cf-a19d-7db0471ca1cc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:45.231737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929c54-e07f-46cf-a19d-7db0471ca1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:45.268545 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-41929c54-e07f-46cf-a19d-7db0471ca1cc None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:45.270834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-41929c54-e07f-46cf-a19d-7db0471ca1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:45.435153 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 389/758] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:45 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:45.481962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827449-1ef6-4693-9ebf-d0ba7b5c4a93 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:45.609492 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:45.689759 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c827449-1ef6-4693-9ebf-d0ba7b5c4a93 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:45.759257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:45.760435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:45.760920 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:45.761449 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:45.762631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:45.765360 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:45.782604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:45.783813 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:45.785549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:45.789402 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 370/759] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Jul 25 20:22:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:45.795206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929c54-e07f-46cf-a19d-7db0471ca1cc None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:46.004006 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929c54-e07f-46cf-a19d-7db0471ca1cc None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:46.054343 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:46.080940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26055841-f148-476b-982a-b5483a9221e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:46.082301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26055841-f148-476b-982a-b5483a9221e1 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:46.082697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26055841-f148-476b-982a-b5483a9221e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:46.083108 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26055841-f148-476b-982a-b5483a9221e1 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:46.084336 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26055841-f148-476b-982a-b5483a9221e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:46.084755 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26055841-f148-476b-982a-b5483a9221e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:46.087834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26055841-f148-476b-982a-b5483a9221e1 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:46.098167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 390/760] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 20:22:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:46.107917 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:46.324130 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358db4-870c-41a5-91f5-6a79dded1f00 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:46.379821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:46.395261 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b47490-3b58-43b4-8794-88ae3c744c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:46.396382 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47490-3b58-43b4-8794-88ae3c744c3a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:46.396928 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47490-3b58-43b4-8794-88ae3c744c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:46.397397 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b47490-3b58-43b4-8794-88ae3c744c3a None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:46.398457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b47490-3b58-43b4-8794-88ae3c744c3a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:46.398836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b47490-3b58-43b4-8794-88ae3c744c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:46.401903 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b47490-3b58-43b4-8794-88ae3c744c3a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:46.410135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 371/761] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 20:22:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:47.311118 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1add07-c618-4c10-8313-b2bdb6bffbd8 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:47.311936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1add07-c618-4c10-8313-b2bdb6bffbd8 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:47.311936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1add07-c618-4c10-8313-b2bdb6bffbd8 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:47.313546 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 391/762] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:22:47.322165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d0a7b-f8a9-40b0-867e-d5e31ff63124 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:47.322562 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d0a7b-f8a9-40b0-867e-d5e31ff63124 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:47.323031 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d0a7b-f8a9-40b0-867e-d5e31ff63124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:47.356923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-757d0a7b-f8a9-40b0-867e-d5e31ff63124 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:47.359098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-757d0a7b-f8a9-40b0-867e-d5e31ff63124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:47.498861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 372/763] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:47 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:47.527115 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1add07-c618-4c10-8313-b2bdb6bffbd8 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:47.692271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1add07-c618-4c10-8313-b2bdb6bffbd8 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:47.734163 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:47.734897 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:47.735239 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:47.735592 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:47.736299 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:47.737788 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:47.749042 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:47.751312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:47.752941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 392/764] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:47.758778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d0a7b-f8a9-40b0-867e-d5e31ff63124 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:47.953957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d0a7b-f8a9-40b0-867e-d5e31ff63124 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:48.001367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:48.021152 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:48.021976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:48.022414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:48.022874 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:48.023687 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:48.024024 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:48.027020 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:48.043477 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 373/765] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:48.045147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:48.130946 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:48.200177 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e9544-a765-4ce3-84cb-e540d2f83e76 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:48.253699 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:48.254584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:48.255027 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:48.255452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:48.256586 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:48.257075 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:48.259613 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:48.268974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 393/766] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:48.278408 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:48.487705 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dfb91-9378-4ad1-a49b-d71faa02c5c3 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:48.554645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a80625-bfd0-44be-94c4-137999ab8e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:48.556268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80625-bfd0-44be-94c4-137999ab8e01 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:48.556721 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80625-bfd0-44be-94c4-137999ab8e01 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:48.557268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a80625-bfd0-44be-94c4-137999ab8e01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:48.558735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a80625-bfd0-44be-94c4-137999ab8e01 None admin] RBAC: Adding query filter params (interface=public, service_id=3914cf5851c648afbae7ec31705f2bef, region_id=RegionOne) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:48.559294 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a80625-bfd0-44be-94c4-137999ab8e01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:48.561752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a80625-bfd0-44be-94c4-137999ab8e01 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:48.572738 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 374/767] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 20:22:48 2022] GET /identity/v3/endpoints?service_id=3914cf5851c648afbae7ec31705f2bef&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:48.582205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:48.797086 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a5100-ea98-4653-967d-1c96996f6931 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:48.836024 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:48.874618 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf409fe-d9db-4a9f-a95d-eaac6ff1c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:48.875635 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf409fe-d9db-4a9f-a95d-eaac6ff1c3be None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:48.876119 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf409fe-d9db-4a9f-a95d-eaac6ff1c3be None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:48.876582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf409fe-d9db-4a9f-a95d-eaac6ff1c3be None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:48.877882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf409fe-d9db-4a9f-a95d-eaac6ff1c3be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:48.880625 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf409fe-d9db-4a9f-a95d-eaac6ff1c3be None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:48.893952 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 394/768] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 20:22:48 2022] GET /identity/v3/services => generated 1241 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:22:49.660828 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092bbd3-f276-468b-b915-88c3c1de467c None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:49.661684 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092bbd3-f276-468b-b915-88c3c1de467c None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:49.661839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092bbd3-f276-468b-b915-88c3c1de467c None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:49.664440 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 375/769] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:49.674658 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586ed8-3279-4505-acb6-c615ffbfa882 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:49.675465 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586ed8-3279-4505-acb6-c615ffbfa882 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:49.675618 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e586ed8-3279-4505-acb6-c615ffbfa882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:49.709008 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-8e586ed8-3279-4505-acb6-c615ffbfa882 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:49.711148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-8e586ed8-3279-4505-acb6-c615ffbfa882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:49.843115 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 395/770] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:49 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:49.885082 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092bbd3-f276-468b-b915-88c3c1de467c None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:49.988416 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:50.079638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092bbd3-f276-468b-b915-88c3c1de467c None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:50.147096 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239c8a5-b084-4fc6-9148-e499d9303061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:50.148222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c8a5-b084-4fc6-9148-e499d9303061 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:50.148765 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c8a5-b084-4fc6-9148-e499d9303061 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:50.149821 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c8a5-b084-4fc6-9148-e499d9303061 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:50.151090 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239c8a5-b084-4fc6-9148-e499d9303061 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:50.153801 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239c8a5-b084-4fc6-9148-e499d9303061 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:50.180099 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 376/771] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:22:49 2022] POST /identity/v3/services => generated 269 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:22:51.629523 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc805-62b3-4841-b2cb-f93de5ac2142 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:51.630130 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc805-62b3-4841-b2cb-f93de5ac2142 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:51.630130 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc805-62b3-4841-b2cb-f93de5ac2142 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:51.631473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 396/772] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:51.638147 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874c29-9994-468c-928c-fc7dd9f7df52 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:51.639014 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874c29-9994-468c-928c-fc7dd9f7df52 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:51.639172 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874c29-9994-468c-928c-fc7dd9f7df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:51.659764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-ee874c29-9994-468c-928c-fc7dd9f7df52 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:51.661026 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ee874c29-9994-468c-928c-fc7dd9f7df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:51.760780 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 377/773] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 20:22:51.786351 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebc805-62b3-4841-b2cb-f93de5ac2142 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:51.911999 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebc805-62b3-4841-b2cb-f93de5ac2142 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:51.925688 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:51.957635 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:51.958297 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:51.958582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:51.958864 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:51.959521 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:51.960970 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:51.971712 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:51.973972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:51.976000 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 397/774] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:51.981934 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee874c29-9994-468c-928c-fc7dd9f7df52 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:52.025707 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:52.128414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee874c29-9994-468c-928c-fc7dd9f7df52 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:52.175494 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:52.176125 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:52.176414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:52.176781 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:52.177825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:52.178096 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:52.179618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:52.186270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 378/775] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:52.193143 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:52.333125 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4985c6-82b8-432d-94ba-f41d0496aca4 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:52.376828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633059c3-ab81-4eac-90fb-b23743ef5ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:52.377664 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633059c3-ab81-4eac-90fb-b23743ef5ad7 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:52.378048 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633059c3-ab81-4eac-90fb-b23743ef5ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:52.378413 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633059c3-ab81-4eac-90fb-b23743ef5ad7 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:52.379219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633059c3-ab81-4eac-90fb-b23743ef5ad7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:52.379620 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633059c3-ab81-4eac-90fb-b23743ef5ad7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:52.381147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633059c3-ab81-4eac-90fb-b23743ef5ad7 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:52.387899 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 398/776] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 20:22:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:52.394645 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:52.575001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:52.578628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2187dc-503b-411f-9fe1-5f98cfe18cce None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:52.622950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7a8d-7107-4de9-9d13-d8ec016f5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:52.623671 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7a8d-7107-4de9-9d13-d8ec016f5841 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:52.624026 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7a8d-7107-4de9-9d13-d8ec016f5841 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:52.624368 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7a8d-7107-4de9-9d13-d8ec016f5841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:52.625233 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a7a8d-7107-4de9-9d13-d8ec016f5841 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:52.626734 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a7a8d-7107-4de9-9d13-d8ec016f5841 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:52.656612 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 379/777] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:22:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:22:53.429630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f671b-cd69-436a-ba99-a145d1c7f733 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:53.430171 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f671b-cd69-436a-ba99-a145d1c7f733 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:53.430925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f671b-cd69-436a-ba99-a145d1c7f733 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:53.434426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 399/778] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:53.442017 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f2c0-c69b-4ff9-a97d-3463bbb5d413 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:53.442517 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f2c0-c69b-4ff9-a97d-3463bbb5d413 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:53.443009 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f2c0-c69b-4ff9-a97d-3463bbb5d413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:53.475867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-5456f2c0-c69b-4ff9-a97d-3463bbb5d413 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:53.478498 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-5456f2c0-c69b-4ff9-a97d-3463bbb5d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:53.632382 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 380/779] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:53.659622 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f671b-cd69-436a-ba99-a145d1c7f733 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:53.744556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:53.834387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f671b-cd69-436a-ba99-a145d1c7f733 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:53.882800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:53.884277 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:53.884666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:53.884957 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:53.885682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:53.887629 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:53.900178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:53.902162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:53.903905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 400/780] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Jul 25 20:22:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:53.909001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456f2c0-c69b-4ff9-a97d-3463bbb5d413 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:54.021042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:54.060548 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456f2c0-c69b-4ff9-a97d-3463bbb5d413 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:54.108444 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:54.109176 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:54.109466 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:54.109741 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:54.110454 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:54.110766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:54.112291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:54.118771 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 381/781] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 20:22:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:54.125787 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:54.344874 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db54ed-f17e-47ab-95ee-000b81a8f00f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:54.347886 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:54.417771 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:54.418883 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:54.419375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:54.419868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:54.421241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:54.421803 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:54.424651 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:54.435856 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 401/782] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 20:22:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:54.445804 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:54.583406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5732a5-f543-4b5e-88d2-b145c2f0c91c None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:54.634526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284aa29-38c7-4805-a55b-dbaef2b99b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:54.635560 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284aa29-38c7-4805-a55b-dbaef2b99b5a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:54.636062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284aa29-38c7-4805-a55b-dbaef2b99b5a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:54.636573 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284aa29-38c7-4805-a55b-dbaef2b99b5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:54.638185 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284aa29-38c7-4805-a55b-dbaef2b99b5a None admin] RBAC: Adding query filter params (interface=public, service_id=454151b763274ee2b9fd4f2e2368e6c1, region_id=RegionOne) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:54.638773 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284aa29-38c7-4805-a55b-dbaef2b99b5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:54.641472 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284aa29-38c7-4805-a55b-dbaef2b99b5a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:54.652457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 382/783] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 20:22:54 2022] GET /identity/v3/endpoints?service_id=454151b763274ee2b9fd4f2e2368e6c1&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:54.659319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:54.827817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d07bc-fe5f-45e1-839c-789bcc905182 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:54.898023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e104b2-1bb1-4a93-a97d-b90a1a93e384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:54.899654 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e104b2-1bb1-4a93-a97d-b90a1a93e384 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:54.900069 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e104b2-1bb1-4a93-a97d-b90a1a93e384 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:54.900567 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e104b2-1bb1-4a93-a97d-b90a1a93e384 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:54.901846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e104b2-1bb1-4a93-a97d-b90a1a93e384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:54.904452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e104b2-1bb1-4a93-a97d-b90a1a93e384 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:54.917313 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 402/784] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 20:22:54 2022] GET /identity/v3/services => generated 1498 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:22:55.652562 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd979e-a027-452f-be3e-c983d0265b81 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:55.653178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd979e-a027-452f-be3e-c983d0265b81 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:55.653178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd979e-a027-452f-be3e-c983d0265b81 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:55.655201 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 383/785] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:55.662253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde80f8d-6170-4f25-8833-2152f1138ab8 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:55.662790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde80f8d-6170-4f25-8833-2152f1138ab8 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:55.663259 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde80f8d-6170-4f25-8833-2152f1138ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:55.690962 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-cde80f8d-6170-4f25-8833-2152f1138ab8 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:55.692192 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-cde80f8d-6170-4f25-8833-2152f1138ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:55.733682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:55.793208 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 403/786] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:55 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:55.820527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd979e-a027-452f-be3e-c983d0265b81 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:55.835151 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:55.944681 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd979e-a027-452f-be3e-c983d0265b81 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:55.991793 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:55.992444 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:55.992727 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:55.993642 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:55.994673 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:55.995942 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:55.998832 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING keystone.server.flask.common [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 20:22:56.020925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.sql.core [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 20:22:56.020925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 20:22:56.020925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [parameters: {'id': 'fcda52c74d6e468da08c5bb618f18c0b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 20:22:56.020925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87208) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fcda52c74d6e468da08c5bb618f18c0b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fcda52c74d6e468da08c5bb618f18c0b. Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application conn.query(q) Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:22:56.042926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application result.read() Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 20:22:56.044521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application next(self.gen) Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application yield resource Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application next(self.gen) Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise self.value Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application session.commit() Jul 25 20:22:56.046366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self.session.flush() Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application compat.raise_( Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 20:22:56.048081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 20:22:56.049918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application conn.query(q) Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application result.read() Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:22:56.051405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [parameters: {'id': 'fcda52c74d6e468da08c5bb618f18c0b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:56.053692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:56.056069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fcda52c74d6e468da08c5bb618f18c0b. Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:22:56.064665 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 384/787] 10.222.0.47 () {60 vars in 1140 bytes} [Mon Jul 25 20:22:55 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:56.066463 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde80f8d-6170-4f25-8833-2152f1138ab8 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:56.208829 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde80f8d-6170-4f25-8833-2152f1138ab8 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:56.278022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c778019-da13-4c3f-879b-c977f19319a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:56.279122 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c778019-da13-4c3f-879b-c977f19319a6 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:56.279606 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c778019-da13-4c3f-879b-c977f19319a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:56.280058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c778019-da13-4c3f-879b-c977f19319a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:56.293873 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c778019-da13-4c3f-879b-c977f19319a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:56.296702 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c778019-da13-4c3f-879b-c977f19319a6 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-1c778019-da13-4c3f-879b-c977f19319a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:22:56.318334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:56.319802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:56.320898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 404/788] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:22:56.330348 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:56.443317 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:56.508001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dbf38-ca20-4313-9697-6f94aa2a8da8 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:56.559655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1890658-ed49-4d6b-9208-2c6efdcad3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:56.560354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1890658-ed49-4d6b-9208-2c6efdcad3f3 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:56.560639 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1890658-ed49-4d6b-9208-2c6efdcad3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:56.560916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1890658-ed49-4d6b-9208-2c6efdcad3f3 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:56.561724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1890658-ed49-4d6b-9208-2c6efdcad3f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:56.562029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1890658-ed49-4d6b-9208-2c6efdcad3f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:56.563892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1890658-ed49-4d6b-9208-2c6efdcad3f3 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:56.588797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 385/789] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:22:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:57.792067 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e958-a9a5-4dec-85df-db0e100fd7f6 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:57.793510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e958-a9a5-4dec-85df-db0e100fd7f6 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:57.793657 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e958-a9a5-4dec-85df-db0e100fd7f6 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:57.797219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 405/790] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:57.806501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fef111-d336-4ec9-a65e-c3197175a906 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:57.807270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fef111-d336-4ec9-a65e-c3197175a906 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:57.807270 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fef111-d336-4ec9-a65e-c3197175a906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:57.829637 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-e6fef111-d336-4ec9-a65e-c3197175a906 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:57.831365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-e6fef111-d336-4ec9-a65e-c3197175a906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:22:57.922367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 386/791] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:57 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:22:57.948505 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e958-a9a5-4dec-85df-db0e100fd7f6 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:57.973941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:58.090339 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e958-a9a5-4dec-85df-db0e100fd7f6 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:58.147007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:58.147697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:58.148029 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:58.148345 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:58.149287 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:58.150908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:22:58.162010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:22:58.164507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:22:58.167151 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 406/792] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Jul 25 20:22:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:22:58.171249 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fef111-d336-4ec9-a65e-c3197175a906 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:58.296660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:58.386999 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fef111-d336-4ec9-a65e-c3197175a906 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:58.460760 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:58.461812 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:58.462248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:58.462671 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:58.463820 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:58.464300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:58.467304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:58.476552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 387/793] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 20:22:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:22:58.485947 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:58.675715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:58.707782 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b341a3e-9fed-4246-bdb6-513df23bc38d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:58.755835 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf5c61-87da-47e0-87e1-e6504476ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:58.756597 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf5c61-87da-47e0-87e1-e6504476ebbc None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:58.756934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf5c61-87da-47e0-87e1-e6504476ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:58.757306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf5c61-87da-47e0-87e1-e6504476ebbc None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:58.758110 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf5c61-87da-47e0-87e1-e6504476ebbc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:22:58.759015 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf5c61-87da-47e0-87e1-e6504476ebbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:58.761182 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf5c61-87da-47e0-87e1-e6504476ebbc None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:58.768252 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 407/794] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 20:22:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:22:58.775535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:22:58.949516 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c564-4998-4187-95bf-04c33b58d957 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:22:58.982037 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:59.003054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bfd4f-5526-43c4-aa8e-1557b1cb1d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:22:59.003876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bfd4f-5526-43c4-aa8e-1557b1cb1d29 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:59.004327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bfd4f-5526-43c4-aa8e-1557b1cb1d29 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:59.004757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bfd4f-5526-43c4-aa8e-1557b1cb1d29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:59.006099 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bfd4f-5526-43c4-aa8e-1557b1cb1d29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:22:59.008160 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bfd4f-5526-43c4-aa8e-1557b1cb1d29 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:22:59.046170 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 388/795] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:22:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:22:59.861168 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71ac5-9936-4ce2-b914-898784448365 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:59.862089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71ac5-9936-4ce2-b914-898784448365 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:59.862248 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71ac5-9936-4ce2-b914-898784448365 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:59.864749 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 408/796] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:22:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:22:59.874367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40dce8-28d6-4db7-a12a-6947f7d0c6ae None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:22:59.874994 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40dce8-28d6-4db7-a12a-6947f7d0c6ae None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:22:59.875553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40dce8-28d6-4db7-a12a-6947f7d0c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:22:59.900628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-6a40dce8-28d6-4db7-a12a-6947f7d0c6ae None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:22:59.902015 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-6a40dce8-28d6-4db7-a12a-6947f7d0c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:23:00.008372 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 389/797] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:22:59 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:23:00.037411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de71ac5-9936-4ce2-b914-898784448365 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:00.227895 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de71ac5-9936-4ce2-b914-898784448365 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:00.303994 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:00.304740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:00.305011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:00.305741 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:00.306240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:00.307903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:00.310996 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING keystone.server.flask.common [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 20:23:00.332163 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.sql.core [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 20:23:00.332163 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 20:23:00.332163 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [parameters: {'user_id': 'e0f1cc13e37045b692cfef84a1aaa41e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 20:23:00.332163 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87207) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application conn.query(q) Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application result.read() Jul 25 20:23:00.361489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 20:23:00.363240 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application next(self.gen) Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application yield resource Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application next(self.gen) Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise self.value Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application session.commit() Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 20:23:00.365514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self.session.flush() Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application compat.raise_( Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 20:23:00.367611 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:23:00.371575 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application conn.query(q) Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application result.read() Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:23:00.373495 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e0f1cc13e37045b692cfef84a1aaa41e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:23:00.375701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 20:23:00.377890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 20:23:00.380040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 20:23:00.380040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 20:23:00.380040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 20:23:00.380040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 20:23:00.380040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 20:23:00.380040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:23:00.380040 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 409/798] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Jul 25 20:23:00 2022] POST /identity/v3/users => generated 160 bytes in 327 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:23:00.380899 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40dce8-28d6-4db7-a12a-6947f7d0c6ae None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:00.564898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40dce8-28d6-4db7-a12a-6947f7d0c6ae None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:00.567890 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:00.629192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d3fc9-9a7c-4632-85cf-4e18b00a4071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:00.630367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3fc9-9a7c-4632-85cf-4e18b00a4071 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:00.630764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3fc9-9a7c-4632-85cf-4e18b00a4071 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:00.631085 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3fc9-9a7c-4632-85cf-4e18b00a4071 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:00.640960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d3fc9-9a7c-4632-85cf-4e18b00a4071 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:00.642506 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d3fc9-9a7c-4632-85cf-4e18b00a4071 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-f46d3fc9-9a7c-4632-85cf-4e18b00a4071 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:23:00.656817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:23:00.658892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:23:00.660227 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 390/799] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:23:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:23:00.670275 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:00.693165 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:00.839298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa070c-930e-4084-a5d8-a7b6e2c2afd0 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:00.893823 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221103-fbcc-4a02-9ffe-f4ae36912d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:00.894527 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221103-fbcc-4a02-9ffe-f4ae36912d09 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:00.894736 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221103-fbcc-4a02-9ffe-f4ae36912d09 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:00.895020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221103-fbcc-4a02-9ffe-f4ae36912d09 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:00.895823 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221103-fbcc-4a02-9ffe-f4ae36912d09 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:23:00.896134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221103-fbcc-4a02-9ffe-f4ae36912d09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:00.897893 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221103-fbcc-4a02-9ffe-f4ae36912d09 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:00.944891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 410/800] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 20:23:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:23:02.086280 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678cc2d-2209-4334-9dfb-04384a68d4fe None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:02.087389 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678cc2d-2209-4334-9dfb-04384a68d4fe None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:02.087743 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678cc2d-2209-4334-9dfb-04384a68d4fe None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:02.090455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 391/801] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:23:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:23:02.096854 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacaece-d3a0-42bf-ab48-57b7a87c2894 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:02.097644 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacaece-d3a0-42bf-ab48-57b7a87c2894 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:02.097644 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacaece-d3a0-42bf-ab48-57b7a87c2894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:02.121471 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-3cacaece-d3a0-42bf-ab48-57b7a87c2894 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:23:02.123198 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-3cacaece-d3a0-42bf-ab48-57b7a87c2894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:23:02.242799 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:02.253473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 411/802] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:23:02 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:23:02.298275 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678cc2d-2209-4334-9dfb-04384a68d4fe None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:02.500944 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678cc2d-2209-4334-9dfb-04384a68d4fe None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:02.551992 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:02.553016 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:02.553424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:02.553727 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] PATH_INFO: `/v3/services/compute` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:02.554541 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:02.557018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:23:02.567756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:23:02.570029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:23:02.573091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 392/803] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:23:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:23:02.580258 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacaece-d3a0-42bf-ab48-57b7a87c2894 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:02.783877 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacaece-d3a0-42bf-ab48-57b7a87c2894 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:02.843427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c9e0-d660-4c81-a840-12ec21681274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:02.844211 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c9e0-d660-4c81-a840-12ec21681274 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:02.844620 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c9e0-d660-4c81-a840-12ec21681274 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:02.845073 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c9e0-d660-4c81-a840-12ec21681274 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:02.846157 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c9e0-d660-4c81-a840-12ec21681274 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:23:02.846666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c9e0-d660-4c81-a840-12ec21681274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:02.848204 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c9e0-d660-4c81-a840-12ec21681274 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:02.855015 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 412/804] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:23:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:23:02.865336 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:02.925123 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:03.043512 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938d229-0715-4d24-ad50-e9f43fd5509b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:03.129947 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e37773-e778-47f0-8173-0e6dd1ae4e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:03.130936 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37773-e778-47f0-8173-0e6dd1ae4e43 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:03.131482 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37773-e778-47f0-8173-0e6dd1ae4e43 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:03.131833 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37773-e778-47f0-8173-0e6dd1ae4e43 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:03.132599 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e37773-e778-47f0-8173-0e6dd1ae4e43 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:23:03.132913 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e37773-e778-47f0-8173-0e6dd1ae4e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:03.134594 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e37773-e778-47f0-8173-0e6dd1ae4e43 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:03.140600 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 393/805] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:23:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:23:05.664370 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5d6d8-8669-426e-a3db-eca9a29f9ea0 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:05.665847 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5d6d8-8669-426e-a3db-eca9a29f9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:05.665847 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5d6d8-8669-426e-a3db-eca9a29f9ea0 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:05.667654 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 413/806] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:23:05.674677 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d5f2-3d9c-45c6-bab6-3e4de9132440 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:05.675320 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d5f2-3d9c-45c6-bab6-3e4de9132440 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:05.675633 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d5f2-3d9c-45c6-bab6-3e4de9132440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:05.703911 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-36a8d5f2-3d9c-45c6-bab6-3e4de9132440 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:23:05.706000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-36a8d5f2-3d9c-45c6-bab6-3e4de9132440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:23:05.854680 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 394/807] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:23:05 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:23:05.900974 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5d6d8-8669-426e-a3db-eca9a29f9ea0 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:06.038714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:06.131766 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5d6d8-8669-426e-a3db-eca9a29f9ea0 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:06.181751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaadd38-b923-48f9-ab5e-2707856e8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:06.182570 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaadd38-b923-48f9-ab5e-2707856e8429 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:06.182906 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaadd38-b923-48f9-ab5e-2707856e8429 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:06.183288 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaadd38-b923-48f9-ab5e-2707856e8429 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:06.184085 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaadd38-b923-48f9-ab5e-2707856e8429 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:06.185812 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaadd38-b923-48f9-ab5e-2707856e8429 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:06.207020 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 414/808] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:23:05 2022] POST /identity/v3/services => generated 242 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:23:09.506308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb8e73-15ea-4fb7-9e45-316e73af8257 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:09.506875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb8e73-15ea-4fb7-9e45-316e73af8257 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:09.506875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb8e73-15ea-4fb7-9e45-316e73af8257 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:09.508919 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 395/809] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:23:09.516406 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72db7c-63a4-47a9-bc74-a11a353593e7 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:09.517050 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72db7c-63a4-47a9-bc74-a11a353593e7 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:09.517185 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72db7c-63a4-47a9-bc74-a11a353593e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:09.537393 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-db72db7c-63a4-47a9-bc74-a11a353593e7 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:23:09.538763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-db72db7c-63a4-47a9-bc74-a11a353593e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:23:09.644763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 415/810] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:23:09 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:23:09.671235 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb8e73-15ea-4fb7-9e45-316e73af8257 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:09.713417 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:09.831098 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb8e73-15ea-4fb7-9e45-316e73af8257 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:09.878449 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:09.879244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:09.879578 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:09.880037 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] PATH_INFO: `/v3/services/compute` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:09.880780 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:09.882406 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:23:09.898139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:23:09.900237 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:23:09.901535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 396/811] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:23:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:23:09.911722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72db7c-63a4-47a9-bc74-a11a353593e7 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:09.988251 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:10.056180 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72db7c-63a4-47a9-bc74-a11a353593e7 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:10.099117 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:10.099790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:10.100078 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:10.100358 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:10.101320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] RBAC: Adding query filter params (name=compute) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:23:10.101691 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:10.103882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:10.109969 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 416/812] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:23:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:23:10.116890 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:10.297383 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:10.330683 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611eae7-c091-4b4b-abb2-217a80f36ddd None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:10.376184 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:10.376775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:10.377154 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:10.377500 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:10.378264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:23:10.378630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:10.380138 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:10.386916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 397/813] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:23:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:23:10.393526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:10.547681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025fa1b-c9b0-4449-a1a1-dce1592136ce None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:10.566876 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:10.600303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04b9a6-225a-4594-9428-ed179af92852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:10.601003 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04b9a6-225a-4594-9428-ed179af92852 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:10.601327 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04b9a6-225a-4594-9428-ed179af92852 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:10.601796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04b9a6-225a-4594-9428-ed179af92852 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:10.603465 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04b9a6-225a-4594-9428-ed179af92852 None admin] RBAC: Adding query filter params (interface=public, service_id=6eab781e90144bbca087da7d8334103f, region_id=RegionOne) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:23:10.603970 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04b9a6-225a-4594-9428-ed179af92852 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:10.605554 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04b9a6-225a-4594-9428-ed179af92852 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:10.612355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 417/814] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 20:23:10 2022] GET /identity/v3/endpoints?service_id=6eab781e90144bbca087da7d8334103f&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:23:10.619828 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:10.788013 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bab3b-d3d0-4e09-abf9-80ff0be0287f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:10.855696 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556ed28-cab2-488d-994b-c5e903c7a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:10.856712 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556ed28-cab2-488d-994b-c5e903c7a90d None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:10.857195 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556ed28-cab2-488d-994b-c5e903c7a90d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:10.857634 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556ed28-cab2-488d-994b-c5e903c7a90d None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:10.858730 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556ed28-cab2-488d-994b-c5e903c7a90d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:10.861165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556ed28-cab2-488d-994b-c5e903c7a90d None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:10.874304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 398/815] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 20:23:10 2022] GET /identity/v3/services => generated 1728 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:23:13.548009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47774f-a164-42b6-a262-4ced9c1489cf None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:13.548613 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47774f-a164-42b6-a262-4ced9c1489cf None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:13.548977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47774f-a164-42b6-a262-4ced9c1489cf None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:13.551642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 418/816] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:23:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:23:13.561557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dba6a-bf56-4d65-958b-3b64c4074195 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:13.562405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dba6a-bf56-4d65-958b-3b64c4074195 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:13.562405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dba6a-bf56-4d65-958b-3b64c4074195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:13.585706 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-586dba6a-bf56-4d65-958b-3b64c4074195 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:23:13.588042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-586dba6a-bf56-4d65-958b-3b64c4074195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:23:13.604126 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:13.697887 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 399/817] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:23:13 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 20:23:13.745391 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47774f-a164-42b6-a262-4ced9c1489cf None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:13.920188 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47774f-a164-42b6-a262-4ced9c1489cf None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:13.971606 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:13.972347 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:13.972683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:13.973029 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] PATH_INFO: `/v3/services/compute` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:13.973774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:13.975356 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:23:13.986821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:23:13.988756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:23:13.990751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 419/818] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:23:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:23:13.997454 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dba6a-bf56-4d65-958b-3b64c4074195 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:14.184143 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dba6a-bf56-4d65-958b-3b64c4074195 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:14.235246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:14.236148 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:14.236505 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:14.236859 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:14.237766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] RBAC: Adding query filter params (name=compute) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:23:14.238229 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:14.240550 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:14.249475 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 400/819] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:23:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:23:14.256356 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:14.314945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:14.398093 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962ce31-c242-4650-8edd-d2373eacbefa None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:14.465019 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e53676-1c49-40d1-8541-bf8a49ad8ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:14.465751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53676-1c49-40d1-8541-bf8a49ad8ddf None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:14.466035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53676-1c49-40d1-8541-bf8a49ad8ddf None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:14.466309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53676-1c49-40d1-8541-bf8a49ad8ddf None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:14.467304 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53676-1c49-40d1-8541-bf8a49ad8ddf None admin] RBAC: Adding query filter params (type=compute) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:23:14.467651 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53676-1c49-40d1-8541-bf8a49ad8ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:14.469213 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53676-1c49-40d1-8541-bf8a49ad8ddf None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:14.476267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 420/820] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 20:23:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:23:14.484600 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:23:14.495470 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:14.660596 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c98d-52a3-4383-836e-1904dce51bfb None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:23:14.715165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53228059-8665-41ab-8b25-dedb248673a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:23:14.715978 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53228059-8665-41ab-8b25-dedb248673a5 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:23:14.716314 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53228059-8665-41ab-8b25-dedb248673a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:23:14.716695 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53228059-8665-41ab-8b25-dedb248673a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:23:14.717615 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53228059-8665-41ab-8b25-dedb248673a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:23:14.719356 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53228059-8665-41ab-8b25-dedb248673a5 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:23:14.753823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 401/821] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:23:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:23:24.472971 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=48 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:24.742584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:36.978296 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a62cdd-e2d8-493c-a5fd-783098cb8581 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:36.980164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a62cdd-e2d8-493c-a5fd-783098cb8581 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:36.980164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a62cdd-e2d8-493c-a5fd-783098cb8581 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:36.982124 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 421/822] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:24:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:24:36.992356 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e14b79-0025-4738-b6e7-c00ed20623dc None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:36.994693 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e14b79-0025-4738-b6e7-c00ed20623dc None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:36.995184 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e14b79-0025-4738-b6e7-c00ed20623dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:37.031250 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-40e14b79-0025-4738-b6e7-c00ed20623dc None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:24:37.032692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-40e14b79-0025-4738-b6e7-c00ed20623dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:24:37.211274 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 402/823] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:24:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:24:37.244804 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a62cdd-e2d8-493c-a5fd-783098cb8581 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:37.459854 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a62cdd-e2d8-493c-a5fd-783098cb8581 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:37.547740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:37.549058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:37.549816 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:37.550359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:37.578609 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:37.581979 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:24:37.616333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:37.618262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:37.620084 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:24:37.620084 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:24:37.620084 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:37.620084 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:24:37.623497 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 422/824] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:37.624964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e14b79-0025-4738-b6e7-c00ed20623dc None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:37.817170 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e14b79-0025-4738-b6e7-c00ed20623dc None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:37.874261 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:37.891193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc1430-5314-465d-a04a-69d05d104c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:37.892511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1430-5314-465d-a04a-69d05d104c23 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:37.893068 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1430-5314-465d-a04a-69d05d104c23 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:37.893814 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1430-5314-465d-a04a-69d05d104c23 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:37.895417 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc1430-5314-465d-a04a-69d05d104c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:37.895955 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc1430-5314-465d-a04a-69d05d104c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:37.899732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc1430-5314-465d-a04a-69d05d104c23 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:37.926625 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 403/825] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:37.937304 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:38.042731 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:38.130804 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5616f-9968-4acc-a5f4-aadba1118400 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:38.208229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b095cd0-0caa-40c9-9312-adb10d0556ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:38.209320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095cd0-0caa-40c9-9312-adb10d0556ae None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:38.209821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095cd0-0caa-40c9-9312-adb10d0556ae None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:38.210628 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b095cd0-0caa-40c9-9312-adb10d0556ae None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:38.212779 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b095cd0-0caa-40c9-9312-adb10d0556ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:38.216135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b095cd0-0caa-40c9-9312-adb10d0556ae None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:38.251779 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 423/826] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 20:24:37 2022] POST /identity/v3/users => generated 251 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:24:41.901598 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343be3-ecfb-4e4a-a5f2-01f4ac3afc02 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:41.904558 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343be3-ecfb-4e4a-a5f2-01f4ac3afc02 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:41.904558 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51343be3-ecfb-4e4a-a5f2-01f4ac3afc02 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:41.905939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 404/827] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:24:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:24:41.917584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934783b-2694-4934-9677-720b4a4e2b4d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:41.918648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934783b-2694-4934-9677-720b4a4e2b4d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:41.918648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934783b-2694-4934-9677-720b4a4e2b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:41.954881 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-4934783b-2694-4934-9677-720b4a4e2b4d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:24:41.957053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4934783b-2694-4934-9677-720b4a4e2b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:24:42.125609 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 424/828] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:24:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:24:42.176122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343be3-ecfb-4e4a-a5f2-01f4ac3afc02 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:42.400892 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51343be3-ecfb-4e4a-a5f2-01f4ac3afc02 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:42.478055 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc2e9c-fc1a-47de-bce4-6479c88f7dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:42.478853 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc2e9c-fc1a-47de-bce4-6479c88f7dcb None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:42.479442 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc2e9c-fc1a-47de-bce4-6479c88f7dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:42.479745 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc2e9c-fc1a-47de-bce4-6479c88f7dcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:42.505338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc2e9c-fc1a-47de-bce4-6479c88f7dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-eadc2e9c-fc1a-47de-bce4-6479c88f7dcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:24:42.516039 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:42.518069 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:24:42.519649 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 405/829] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:24:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:42.530292 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934783b-2694-4934-9677-720b4a4e2b4d None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:42.618667 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:42.758678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934783b-2694-4934-9677-720b4a4e2b4d None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:42.835603 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:42.837247 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:42.837814 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:42.838207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:42.839560 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:42.840109 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:42.842888 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:42.862955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 425/830] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:24:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:42.872165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc2e9c-fc1a-47de-bce4-6479c88f7dcb None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:42.979542 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:43.103295 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc2e9c-fc1a-47de-bce4-6479c88f7dcb None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:43.182844 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:43.184087 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:43.191323 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:43.191323 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:43.204571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:43.206646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:24:43.240735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:43.244430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:43.246565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:24:43.246565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:24:43.246565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:43.246565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:24:43.246565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 406/831] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:43.255536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:43.472068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:43.476975 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5fe78-ef95-4044-a298-e3297f08ca8b None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:43.552718 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:43.554311 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:43.554783 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:43.555582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:43.557157 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:43.557814 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:43.560826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:43.587044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 426/832] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:43.599970 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:43.784853 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:43.791601 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337afc3-80dd-4469-84d3-0a070213a6ff None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:43.850187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:43.851248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:43.851738 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:43.852863 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:43.865142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:43.867219 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:24:43.890974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:43.892975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:24:43.895279 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 407/833] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:43.900779 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:44.109344 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634892-c4fc-4ea7-a010-be5424d17c7a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:44.173254 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:44.174480 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:44.175022 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:44.175659 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:44.177485 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:44.178136 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:44.182116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:44.217067 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 427/834] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 20:24:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:24:44.230456 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:44.441391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1c1e9-a8c2-4285-a015-f74620a6c8b8 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:44.506280 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a35d7-bdc9-4b19-a514-c6f4d81d2591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:44.507390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a35d7-bdc9-4b19-a514-c6f4d81d2591 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:44.507900 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a35d7-bdc9-4b19-a514-c6f4d81d2591 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:44.509907 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a35d7-bdc9-4b19-a514-c6f4d81d2591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:44.567723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:44.644885 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a35d7-bdc9-4b19-a514-c6f4d81d2591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:44.647720 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a35d7-bdc9-4b19-a514-c6f4d81d2591 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:44.878863 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 408/835] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:24:44 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 20:24:44.887959 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:44.924482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:45.119825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dedfd-e1bb-4db7-9832-baa13968c257 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:45.199063 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:45.200505 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:45.201025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:45.201559 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:45.225408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:45.229070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:24:45.262719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:45.264775 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:45.266815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:24:45.266815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:24:45.266815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:45.266815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:24:45.266815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 428/836] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:45.277962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a35d7-bdc9-4b19-a514-c6f4d81d2591 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:45.424547 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:45.531042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a35d7-bdc9-4b19-a514-c6f4d81d2591 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:45.597997 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:45.598816 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:45.599180 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:45.599618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:45.601452 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:45.602085 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:45.605427 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:45.629149 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 409/837] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:45.642947 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:45.789295 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:45.871192 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada6742-5e5d-40bd-aeca-6adbe5f6418d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:45.957582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:45.958920 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:45.959510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:45.960002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:45.974904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:45.978406 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:24:46.003253 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:46.005462 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:24:46.007666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 429/838] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:46.016211 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:46.239077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95145c4-2722-42e0-81e0-2d7290368995 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:46.277886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:46.305752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2890-2ea2-49db-848e-30313a6b2e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:46.307081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2890-2ea2-49db-848e-30313a6b2e5e None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:46.307607 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2890-2ea2-49db-848e-30313a6b2e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:46.308112 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2890-2ea2-49db-848e-30313a6b2e5e None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:46.309661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2890-2ea2-49db-848e-30313a6b2e5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:46.310244 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2890-2ea2-49db-848e-30313a6b2e5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:46.313083 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2890-2ea2-49db-848e-30313a6b2e5e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:46.336728 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 410/839] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:24:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:46.345819 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:46.574539 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bde40-dca1-4d54-b02d-d69af7a38f43 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:46.643393 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:46.656665 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d8b7e-55ab-4a20-9437-28b87da00ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:46.657934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8b7e-55ab-4a20-9437-28b87da00ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:46.658448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8b7e-55ab-4a20-9437-28b87da00ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:46.658937 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d8b7e-55ab-4a20-9437-28b87da00ce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:46.660711 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d8b7e-55ab-4a20-9437-28b87da00ce2 None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=6e44d14442bf41598e92099a4bd9ace2) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:46.661351 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d8b7e-55ab-4a20-9437-28b87da00ce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:46.664156 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d8b7e-55ab-4a20-9437-28b87da00ce2 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:46.686657 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 430/840] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:24:46 2022] GET /identity/v3/role_assignments?user.id=6e44d14442bf41598e92099a4bd9ace2&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:50.283794 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed34ff-626f-4f48-92be-b287be814eb3 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:50.284699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed34ff-626f-4f48-92be-b287be814eb3 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:50.284852 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed34ff-626f-4f48-92be-b287be814eb3 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:50.287435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 411/841] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:24:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:24:50.298396 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889efa4b-b2d9-4081-8c86-252b82862da8 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:50.299503 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889efa4b-b2d9-4081-8c86-252b82862da8 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:50.299503 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889efa4b-b2d9-4081-8c86-252b82862da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:50.330415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-889efa4b-b2d9-4081-8c86-252b82862da8 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:24:50.332172 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-889efa4b-b2d9-4081-8c86-252b82862da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:24:50.486290 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 431/842] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:24:50 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:24:50.535082 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed34ff-626f-4f48-92be-b287be814eb3 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:50.756065 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed34ff-626f-4f48-92be-b287be814eb3 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:50.831429 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678796b9-f9ff-464e-9397-a67a3f3232ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:50.832005 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678796b9-f9ff-464e-9397-a67a3f3232ef None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:50.832288 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678796b9-f9ff-464e-9397-a67a3f3232ef None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:50.832565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678796b9-f9ff-464e-9397-a67a3f3232ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:50.854661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678796b9-f9ff-464e-9397-a67a3f3232ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-678796b9-f9ff-464e-9397-a67a3f3232ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:24:50.865046 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:50.866543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:24:50.867399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:24:50.870019 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 412/843] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:24:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:50.878412 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889efa4b-b2d9-4081-8c86-252b82862da8 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:51.061484 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889efa4b-b2d9-4081-8c86-252b82862da8 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:51.110540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:51.133081 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:51.134732 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:51.135227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:51.135722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:51.137131 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] RBAC: Adding query filter params (name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:51.137664 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:51.140286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:51.157284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 432/844] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:24:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:51.167696 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678796b9-f9ff-464e-9397-a67a3f3232ef None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:51.238506 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:51.356313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678796b9-f9ff-464e-9397-a67a3f3232ef None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:51.427842 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:51.429316 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:51.429855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:51.429855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:51.452795 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:51.455391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:24:51.484374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:51.486289 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:51.488159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:24:51.488159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:24:51.488159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:51.488159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:24:51.488159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 413/845] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:51.494012 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:51.710315 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e388-2441-4a51-b2e7-d1908cb18131 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:51.771500 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:51.772589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:51.773067 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:51.773476 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:51.775359 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:51.775874 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:51.777593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:51.801519 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 433/846] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:24:51.812447 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:52.009345 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:52.035052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7a10f-5f20-4d98-a07c-7d60ab0a99e1 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:52.115264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:52.116290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:52.116732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:52.117223 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:52.132604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:52.136135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:24:52.159077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:52.161424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:24:52.163177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 414/847] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:52.171480 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:52.269012 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:52.372286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffcdcb-06d9-43b8-b8e6-43141dc89e2e None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:52.439895 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:52.441401 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:52.441874 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:52.442338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:52.443629 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:52.444119 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:52.447925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:52.486597 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 434/848] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 20:24:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:24:52.497852 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:52.678817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f978bc-d365-4632-97a7-af08a0d36653 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:52.728886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:52.729703 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:52.730192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:52.730664 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:52.748619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:52.750647 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:24:52.773571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:52.775391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:52.777088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:24:52.777088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:24:52.777088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:52.777088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:24:52.782355 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 415/849] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:52.785264 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:53.019263 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae760cb-60ad-4d23-a465-6709929db083 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:53.025024 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:53.101404 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:53.102698 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:53.103011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:53.103381 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:53.104280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:53.104900 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:53.107873 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:53.132070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 435/850] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:53.142709 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:53.147601 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:53.354660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2795511-dfbb-44e6-a134-56285fce8d62 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:53.425570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:53.426873 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:53.427568 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:53.428063 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:53.442618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:53.446402 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:24:53.472810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:53.474819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:24:53.478106 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 416/851] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:24:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:53.483945 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:53.669150 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb4fb-3c08-4f83-8da9-a0673a227c83 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:53.737391 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe3c2-813c-43d3-bf5b-3b101b5b2080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:53.738523 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe3c2-813c-43d3-bf5b-3b101b5b2080 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:53.738995 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe3c2-813c-43d3-bf5b-3b101b5b2080 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:53.739507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe3c2-813c-43d3-bf5b-3b101b5b2080 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:53.741133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfe3c2-813c-43d3-bf5b-3b101b5b2080 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:53.741908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfe3c2-813c-43d3-bf5b-3b101b5b2080 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:53.744942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfe3c2-813c-43d3-bf5b-3b101b5b2080 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:53.772496 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 436/852] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:24:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:53.783366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:53.896954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:53.980476 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139b04-d5fd-4ac9-b491-b55b4047fb9a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:54.054247 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a86798-f444-49f7-86c1-ca9baf4d0334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:54.056182 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86798-f444-49f7-86c1-ca9baf4d0334 None admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:54.056837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86798-f444-49f7-86c1-ca9baf4d0334 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:54.057286 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86798-f444-49f7-86c1-ca9baf4d0334 None admin] PATH_INFO: `/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/6e44d14442bf41598e92099a4bd9ace2/roles/c6eecb246d9a4b87b2e57fa42e7d033b` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:54.083275 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a86798-f444-49f7-86c1-ca9baf4d0334 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcba1bed6cbb44dd8da5613751435133, user_id=6e44d14442bf41598e92099a4bd9ace2, role_id=c6eecb246d9a4b87b2e57fa42e7d033b)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:54.085799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a86798-f444-49f7-86c1-ca9baf4d0334 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:54.111184 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 417/853] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:24:53 2022] PUT /identity/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/6e44d14442bf41598e92099a4bd9ace2/roles/c6eecb246d9a4b87b2e57fa42e7d033b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:24:57.928441 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a532aad-8f10-411f-8890-621972e943f3 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:57.929610 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a532aad-8f10-411f-8890-621972e943f3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:57.929796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a532aad-8f10-411f-8890-621972e943f3 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:57.933154 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 437/854] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:24:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:24:57.944329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc30ab-8577-45d5-9434-217059fe6046 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:57.945183 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc30ab-8577-45d5-9434-217059fe6046 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:57.945533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc30ab-8577-45d5-9434-217059fe6046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:57.980366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-ebbc30ab-8577-45d5-9434-217059fe6046 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:24:57.982718 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ebbc30ab-8577-45d5-9434-217059fe6046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:24:58.103554 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 418/855] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:24:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:24:58.133555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a532aad-8f10-411f-8890-621972e943f3 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:58.186374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:58.330599 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a532aad-8f10-411f-8890-621972e943f3 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:58.411895 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a3704-234d-4d68-a749-1f1851a3d5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:58.412938 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a3704-234d-4d68-a749-1f1851a3d5b8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:58.413642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a3704-234d-4d68-a749-1f1851a3d5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:58.414241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a3704-234d-4d68-a749-1f1851a3d5b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:58.440441 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a3704-234d-4d68-a749-1f1851a3d5b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-f37a3704-234d-4d68-a749-1f1851a3d5b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:24:58.453018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:58.455215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:24:58.457071 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 438/856] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 20:24:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:24:58.466749 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc30ab-8577-45d5-9434-217059fe6046 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:58.547683 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:58.657345 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc30ab-8577-45d5-9434-217059fe6046 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:58.714197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:58.714696 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:58.714988 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:58.715269 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:58.716029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] RBAC: Adding query filter params (name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:58.716352 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:58.717855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:58.734260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 419/857] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 20:24:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:58.742674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a3704-234d-4d68-a749-1f1851a3d5b8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:58.915868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:58.946587 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a3704-234d-4d68-a749-1f1851a3d5b8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:59.007494 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:59.010015 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:59.010532 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:59.011035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:59.042023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:59.045893 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:24:59.080538 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:59.082593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:59.084682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:24:59.084682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:24:59.084682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:24:59.084682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:24:59.084682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 439/858] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:59.092194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:59.313399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee01a4-e840-4d66-bb1b-05bae62bdd03 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:59.317031 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:59.370122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:59.370797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:59.371077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:59.371351 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:59.372070 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:24:59.372463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:59.374727 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:59.399153 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 420/859] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:24:59.406199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:59.629200 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92a2cb-485c-472f-a7f6-537601d3187d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:24:59.697862 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:24:59.698472 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:24:59.698772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:24:59.699133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:24:59.703321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:59.710599 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:24:59.712656 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:24:59.729645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:24:59.731855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:24:59.734060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 440/860] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:24:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:24:59.746593 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:24:59.950123 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf622e9-c75f-444f-b3cc-fd4d10941659 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:00.014831 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:00.015486 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:00.015850 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:00.016262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:00.018743 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:00.018968 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:00.022083 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:00.051251 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 421/861] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 20:24:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:00.063486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:00.277055 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a58ea-0713-467e-9706-0f1820865ad0 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:00.341727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c403bab-5bf8-4e16-8968-5fa610ec6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:00.342850 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c403bab-5bf8-4e16-8968-5fa610ec6947 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:00.343317 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c403bab-5bf8-4e16-8968-5fa610ec6947 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:00.343785 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c403bab-5bf8-4e16-8968-5fa610ec6947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:00.463931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:00.475715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c403bab-5bf8-4e16-8968-5fa610ec6947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:00.478439 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c403bab-5bf8-4e16-8968-5fa610ec6947 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:00.655178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 441/862] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:25:00 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 20:25:00.665234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:00.699812 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:00.840455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c948932-5c99-499e-b22a-bce3ee25ffee None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:00.909698 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:00.910343 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:00.910833 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:00.911184 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:00.929756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:00.932150 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:25:00.953802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:00.955526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:00.957278 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:25:00.957278 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:25:00.957278 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:00.957278 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:00.957278 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 422/863] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:00.963664 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c403bab-5bf8-4e16-8968-5fa610ec6947 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:01.125094 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:01.133394 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c403bab-5bf8-4e16-8968-5fa610ec6947 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:01.199814 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:01.200761 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:01.201153 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:01.201537 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:01.202610 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:01.203776 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:01.205307 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:01.226493 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 442/864] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:01.238251 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:01.395930 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:01.453391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52bf0c-06a8-40a3-b2d4-d0ab7682911b None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:01.527776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:01.528486 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:01.528749 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:01.529182 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:01.538034 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:01.540984 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:25:01.558188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:01.560109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:01.567628 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 423/865] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:01.568681 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:01.789021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947afbe-bb8f-4a85-ac4a-d30e1f3c2be4 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:01.865845 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa3425-8b2c-4ad7-91c8-76486c0515b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:01.866908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa3425-8b2c-4ad7-91c8-76486c0515b4 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:01.870283 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa3425-8b2c-4ad7-91c8-76486c0515b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:01.870283 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa3425-8b2c-4ad7-91c8-76486c0515b4 None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:01.870283 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa3425-8b2c-4ad7-91c8-76486c0515b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:01.870814 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa3425-8b2c-4ad7-91c8-76486c0515b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:01.873742 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa3425-8b2c-4ad7-91c8-76486c0515b4 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:01.896186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 443/866] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:01.907018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:02.112247 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0ac4f-a5a8-43ec-ac4c-edbb2b031ce4 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:02.195730 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33d80-bee6-4950-a357-ea6192f2de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:02.197035 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33d80-bee6-4950-a357-ea6192f2de2f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:02.197589 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33d80-bee6-4950-a357-ea6192f2de2f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:02.198091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33d80-bee6-4950-a357-ea6192f2de2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:02.199659 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33d80-bee6-4950-a357-ea6192f2de2f None admin] RBAC: Adding query filter params (role.id=c6eecb246d9a4b87b2e57fa42e7d033b, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=6e44d14442bf41598e92099a4bd9ace2) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:02.200236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33d80-bee6-4950-a357-ea6192f2de2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:02.203225 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33d80-bee6-4950-a357-ea6192f2de2f None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:02.207038 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:02.219200 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 424/867] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:25:01 2022] GET /identity/v3/role_assignments?user.id=6e44d14442bf41598e92099a4bd9ace2&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=c6eecb246d9a4b87b2e57fa42e7d033b => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:05.533903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3517c7-e513-4801-83fd-07bea68b588f None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:05.534740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3517c7-e513-4801-83fd-07bea68b588f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:05.534897 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3517c7-e513-4801-83fd-07bea68b588f None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:05.540158 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 444/868] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:25:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:25:05.549928 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48cc76-fcd1-4956-9640-075ca756e887 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:05.550620 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48cc76-fcd1-4956-9640-075ca756e887 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:05.550918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48cc76-fcd1-4956-9640-075ca756e887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:05.579297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-9f48cc76-fcd1-4956-9640-075ca756e887 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:25:05.581271 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-9f48cc76-fcd1-4956-9640-075ca756e887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:25:05.709156 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 425/869] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:25:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:25:05.757639 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3517c7-e513-4801-83fd-07bea68b588f None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:05.784725 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:05.956308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3517c7-e513-4801-83fd-07bea68b588f None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:06.029405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d808e3-f24d-4a9d-b76b-6fc50152f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:06.030116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d808e3-f24d-4a9d-b76b-6fc50152f1cc None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:06.030443 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d808e3-f24d-4a9d-b76b-6fc50152f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:06.030729 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d808e3-f24d-4a9d-b76b-6fc50152f1cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:06.060906 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d808e3-f24d-4a9d-b76b-6fc50152f1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-a1d808e3-f24d-4a9d-b76b-6fc50152f1cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:25:06.066101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:06.069447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:06.071913 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 445/870] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:25:06.079769 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48cc76-fcd1-4956-9640-075ca756e887 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:06.310282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48cc76-fcd1-4956-9640-075ca756e887 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:06.354302 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:06.372862 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:06.373738 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:06.374282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:06.374662 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:06.375710 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:06.376190 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:06.378853 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:06.397310 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 426/871] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:06.408057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d808e3-f24d-4a9d-b76b-6fc50152f1cc None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:06.537346 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:06.580934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d808e3-f24d-4a9d-b76b-6fc50152f1cc None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:06.643888 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:06.644819 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:06.645282 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:06.645714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:06.664746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:06.668138 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:25:06.693355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:06.694733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:06.695956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:25:06.695956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:25:06.695956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:06.695956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:06.695956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 446/872] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:06.703555 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:06.876873 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94123eb-b829-4373-8627-9211dfb4ba16 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:06.950374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:06.951378 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:06.951886 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:06.952389 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:06.953736 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:06.954281 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:06.957199 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:06.991646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 427/873] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:06.994377 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:07.209507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cb39e-2737-4b7d-a336-297a8da01f98 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:07.263625 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:07.280431 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:07.281582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:07.282106 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:07.282623 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:07.299249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:07.302181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:25:07.326031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:07.327267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:07.328820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 447/874] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:07.340167 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:07.447240 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:07.537776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2f48e-6a88-4a1d-95f9-edc80a1d0472 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:07.594612 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:07.595584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:07.596175 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:07.596412 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:07.597608 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:07.597930 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:07.599425 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:07.626972 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 428/875] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 20:25:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:07.636202 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:07.852267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a92b-a1aa-4b47-89a2-bfc1c9467853 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:07.925522 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f98db-3904-4eaa-a630-a302bd31086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:07.926578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f98db-3904-4eaa-a630-a302bd31086d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:07.926995 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f98db-3904-4eaa-a630-a302bd31086d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:07.927429 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f98db-3904-4eaa-a630-a302bd31086d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:08.018750 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:08.044741 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f98db-3904-4eaa-a630-a302bd31086d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:08.047587 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f98db-3904-4eaa-a630-a302bd31086d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:08.235284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 448/876] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:25:07 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 20:25:08.249118 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:08.458712 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688abb-cc04-414f-973e-83aa69ad3898 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:08.487864 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:08.546415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:08.547977 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:08.548705 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:08.549357 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:08.577605 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:08.580075 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:25:08.612619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:08.614830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:08.616925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:25:08.616925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:25:08.616925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:08.616925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:08.618719 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 429/877] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:08.626890 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f98db-3904-4eaa-a630-a302bd31086d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:08.831268 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:08.855684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f98db-3904-4eaa-a630-a302bd31086d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:08.922180 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:08.923172 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:08.923642 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:08.924136 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:08.925329 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:08.925735 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:08.927310 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:08.944351 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 449/878] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:08.955562 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:09.155246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781837f4-a053-411c-8af0-3ea43a9ca8a7 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:09.220895 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:09.221872 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:09.222247 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:09.222507 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:09.236060 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:09.239303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:25:09.265431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:09.268326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:09.271111 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 430/879] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:25:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:09.280179 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:09.497411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbf29-8dc6-4110-932b-bb3dd3dd0895 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:09.556094 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c979e-7301-42d2-8ede-1914eaf17eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:09.557427 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c979e-7301-42d2-8ede-1914eaf17eee None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:09.558017 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c979e-7301-42d2-8ede-1914eaf17eee None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:09.558504 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c979e-7301-42d2-8ede-1914eaf17eee None admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:09.560120 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c979e-7301-42d2-8ede-1914eaf17eee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:09.560790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c979e-7301-42d2-8ede-1914eaf17eee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:09.564574 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c979e-7301-42d2-8ede-1914eaf17eee None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:09.604581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 450/880] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:25:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:25:09.611374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:09.660014 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:09.833740 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7689e-2869-4f41-aa24-742273cbf7e0 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:09.904800 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22295-584b-43b2-bb51-7607318b6409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:09.905934 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22295-584b-43b2-bb51-7607318b6409 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:09.906379 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22295-584b-43b2-bb51-7607318b6409 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:09.906837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22295-584b-43b2-bb51-7607318b6409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:09.908305 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22295-584b-43b2-bb51-7607318b6409 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=6e44d14442bf41598e92099a4bd9ace2) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:09.908854 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22295-584b-43b2-bb51-7607318b6409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:09.911653 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22295-584b-43b2-bb51-7607318b6409 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:09.923663 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 431/881] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:25:09 2022] GET /identity/v3/role_assignments?user.id=6e44d14442bf41598e92099a4bd9ace2&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=671de95ce54744059ab540d90d3b40ce => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:13.383504 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de278eb9-ed2b-4f9b-90ec-1fe121f0bf99 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:13.384527 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de278eb9-ed2b-4f9b-90ec-1fe121f0bf99 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:13.384527 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de278eb9-ed2b-4f9b-90ec-1fe121f0bf99 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:13.386662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 451/882] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:25:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:25:13.396108 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e112c-5043-4dca-af14-74ea518b3880 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:13.396891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e112c-5043-4dca-af14-74ea518b3880 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:13.397147 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e112c-5043-4dca-af14-74ea518b3880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:13.440611 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-449e112c-5043-4dca-af14-74ea518b3880 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:25:13.443010 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-449e112c-5043-4dca-af14-74ea518b3880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:25:13.586759 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 432/883] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:25:13 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:25:13.615864 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de278eb9-ed2b-4f9b-90ec-1fe121f0bf99 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:13.640441 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:13.832967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de278eb9-ed2b-4f9b-90ec-1fe121f0bf99 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:13.902044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de468b18-18ee-43ec-9a0b-79754fbf9606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:13.903045 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de468b18-18ee-43ec-9a0b-79754fbf9606 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:13.903531 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de468b18-18ee-43ec-9a0b-79754fbf9606 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:13.904011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de468b18-18ee-43ec-9a0b-79754fbf9606 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:13.925794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de468b18-18ee-43ec-9a0b-79754fbf9606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-de468b18-18ee-43ec-9a0b-79754fbf9606 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:25:13.936668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:13.937967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:25:13.939112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:13.942132 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 452/884] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:13.949672 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e112c-5043-4dca-af14-74ea518b3880 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:13.978671 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:14.137674 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e112c-5043-4dca-af14-74ea518b3880 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:14.205213 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:14.206261 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:14.206754 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:14.207241 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:14.208611 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:14.209193 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:14.212534 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:14.230055 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 433/885] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:14.237444 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de468b18-18ee-43ec-9a0b-79754fbf9606 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:14.379612 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:14.440134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de468b18-18ee-43ec-9a0b-79754fbf9606 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:14.483017 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:14.483674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:14.483955 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:14.484293 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:14.498144 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:14.499854 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:25:14.517828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:14.519536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:14.521593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:25:14.521593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:25:14.521593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:14.521593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:14.521593 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 453/886] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:14.527661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:14.626328 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:14.656673 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2e88f-4a5b-442d-ac0a-cd6db95ba229 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:14.698423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:14.699057 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:14.699342 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:14.699623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:14.700329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:14.700633 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:14.702097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:14.719420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 434/887] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:14.729146 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:14.866847 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a4e4-cd61-478a-970f-9f80691f1b0d None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:14.892700 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:14.911363 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:14.912113 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:14.912397 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:14.912680 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:14.923007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:14.924528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:25:14.939229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:14.941380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:14.943636 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 454/888] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:14.949455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:15.080285 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406296-3be6-4eb1-8a02-8b74664eb6a2 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:15.126502 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:15.127011 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:15.127291 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:15.127562 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:15.128374 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:15.128692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:15.130215 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:15.134056 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:15.153555 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 435/889] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 20:25:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:15.162944 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:15.287177 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe80a0-a325-4b1f-9110-93eb2ce101d6 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:15.355208 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:15.356319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:15.356824 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:15.357368 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:15.380885 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:15.384540 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:25:15.405660 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:15.407432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:15.408972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:25:15.408972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:25:15.408972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:15.408972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:15.408972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 455/890] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:15.416028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:15.548933 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915002a3-bb75-4ed7-bff9-b41e454410ed None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:15.601975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:15.602664 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:15.602991 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:15.603215 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:15.604001 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:15.604263 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:15.605711 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:15.620072 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 436/891] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:25:15.626920 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:15.682408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:15.786259 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd55fa-e037-45ca-aee1-01d0e9840e86 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:15.855423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:15.856607 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:15.857069 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:15.857704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:15.873468 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:15.877091 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:25:15.903148 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:15.904285 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:15.906044 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 456/892] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:25:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:15.916601 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:16.024996 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:16.115512 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a4451-705f-4610-adf7-a94b511e3a82 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:16.183025 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c077a7-fff9-4dff-8bb8-4c9d880addb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:16.184122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c077a7-fff9-4dff-8bb8-4c9d880addb8 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:16.184557 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c077a7-fff9-4dff-8bb8-4c9d880addb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:16.185006 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c077a7-fff9-4dff-8bb8-4c9d880addb8 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:16.186420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c077a7-fff9-4dff-8bb8-4c9d880addb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:16.186964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c077a7-fff9-4dff-8bb8-4c9d880addb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:16.189721 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c077a7-fff9-4dff-8bb8-4c9d880addb8 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:16.214738 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 437/893] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:25:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:25:16.222599 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:16.412608 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:16.431515 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed50e7-7b0c-43bc-a9fd-e8eb85528b3f None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:16.498715 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501114e-0061-42fa-a9a5-325d7025c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:16.500177 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501114e-0061-42fa-a9a5-325d7025c985 None admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:16.500701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501114e-0061-42fa-a9a5-325d7025c985 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:16.501294 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501114e-0061-42fa-a9a5-325d7025c985 None admin] PATH_INFO: `/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/6e44d14442bf41598e92099a4bd9ace2/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:16.505410 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501114e-0061-42fa-a9a5-325d7025c985 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcba1bed6cbb44dd8da5613751435133, user_id=6e44d14442bf41598e92099a4bd9ace2, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:16.508754 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501114e-0061-42fa-a9a5-325d7025c985 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:16.528323 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 457/894] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 20:25:16 2022] PUT /identity/v3/projects/fcba1bed6cbb44dd8da5613751435133/users/6e44d14442bf41598e92099a4bd9ace2/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:25:19.748519 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b32b-5acf-4a5f-8333-90d2dbdb0bca None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:19.749190 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b32b-5acf-4a5f-8333-90d2dbdb0bca None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:19.749190 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b32b-5acf-4a5f-8333-90d2dbdb0bca None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:19.750510 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 438/895] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:25:19.757366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8f47-f6dd-4642-8890-2c02b5a76a69 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:19.759034 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8f47-f6dd-4642-8890-2c02b5a76a69 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:19.759378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8f47-f6dd-4642-8890-2c02b5a76a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:19.779589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-bcaa8f47-f6dd-4642-8890-2c02b5a76a69 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:25:19.780862 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-bcaa8f47-f6dd-4642-8890-2c02b5a76a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:25:19.866563 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 458/896] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:25:19 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:25:19.897932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b32b-5acf-4a5f-8333-90d2dbdb0bca None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:20.034149 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b32b-5acf-4a5f-8333-90d2dbdb0bca None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:20.057009 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:20.097593 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30545f7-f90d-485a-b758-42a9b0d43a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:20.098738 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30545f7-f90d-485a-b758-42a9b0d43a2f None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:20.099210 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30545f7-f90d-485a-b758-42a9b0d43a2f None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:20.099713 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30545f7-f90d-485a-b758-42a9b0d43a2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:20.121389 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30545f7-f90d-485a-b758-42a9b0d43a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-c30545f7-f90d-485a-b758-42a9b0d43a2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 20:25:20.130925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:20.132376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:20.133855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 439/897] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 20:25:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:20.143118 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8f47-f6dd-4642-8890-2c02b5a76a69 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:20.253307 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:20.278542 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8f47-f6dd-4642-8890-2c02b5a76a69 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:20.325849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:20.326500 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:20.326786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:20.327064 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:20.327809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:20.328123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:20.329731 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:20.341140 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 459/898] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 20:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:25:20.348256 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30545f7-f90d-485a-b758-42a9b0d43a2f None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:20.538538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30545f7-f90d-485a-b758-42a9b0d43a2f None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:20.598686 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:20.599441 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:20.599927 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:20.600350 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:20.628641 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:20.630748 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:25:20.660293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:20.661533 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:20.662818 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:25:20.662818 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:25:20.662818 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:20.662818 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:20.662818 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 440/899] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:20.671857 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:20.822629 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aec925-a087-4e04-98b2-994959e7e0f8 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:20.873029 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:20.873916 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:20.873916 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:20.874135 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:20.874867 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:20.875186 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:20.876601 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:20.892396 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 460/900] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:20.899981 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:20.936273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:21.039066 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171eac0-95bc-4254-b1fc-dc3b5384e064 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:21.086489 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:21.087394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:21.087757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:21.088127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:21.099399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:21.100936 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 20:25:21.116058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:21.118171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:21.119453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 441/901] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:21.125164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:21.130481 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:21.269499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f74f5-cc87-4da7-bdcd-2f0f98f70f3a None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:21.319311 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:21.320486 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:21.320855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:21.321317 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:21.322172 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:21.322526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:21.324099 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:21.351958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 461/902] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 20:25:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:21.362032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:21.542313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:21.575724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2c574-9166-4022-9ed5-7cc2ae54e726 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:21.645797 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e496-27e7-477e-93ee-c68956b8de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:21.646875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e496-27e7-477e-93ee-c68956b8de95 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:21.647419 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e496-27e7-477e-93ee-c68956b8de95 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:21.647859 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e496-27e7-477e-93ee-c68956b8de95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:21.750440 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e496-27e7-477e-93ee-c68956b8de95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:21.751948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e496-27e7-477e-93ee-c68956b8de95 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:21.907967 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:21.939512 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 442/903] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 20:25:21 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 20:25:21.949694 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:22.035265 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:22.116476 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43c97c-10e2-4482-8bec-308a93303840 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:22.187007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:22.188001 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:22.188494 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:22.188976 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:22.209878 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:22.213866 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 20:25:22.243964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:22.245072 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:22.246219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 20:25:22.246219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 20:25:22.246219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 20:25:22.246219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:22.246219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 462/904] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:25:22.256951 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e496-27e7-477e-93ee-c68956b8de95 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:22.435101 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e496-27e7-477e-93ee-c68956b8de95 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:22.483568 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:22.484273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:22.484601 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:22.484943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:22.485995 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:22.486351 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:22.487864 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:22.502919 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 443/905] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 20:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:22.510685 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:22.693892 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc196e84-9ddc-4f99-a810-90d8f2241603 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:22.716570 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:22.744196 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:22.744777 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:22.745122 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:22.745451 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:22.754237 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:22.755764 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 20:25:22.770097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:22.772010 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: ERROR keystone.server.flask.application Jul 25 20:25:22.775790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 463/906] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 20:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:22.780162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:22.844611 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:22.946951 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34858-9ffe-4cf3-8fe8-2c2449013389 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:23.008109 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127d1ac-5e28-4999-8c9e-edfbcb0b8fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:23.008978 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127d1ac-5e28-4999-8c9e-edfbcb0b8fd4 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:23.009423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127d1ac-5e28-4999-8c9e-edfbcb0b8fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:23.009724 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127d1ac-5e28-4999-8c9e-edfbcb0b8fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:23.010629 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127d1ac-5e28-4999-8c9e-edfbcb0b8fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:23.011006 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127d1ac-5e28-4999-8c9e-edfbcb0b8fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:23.012571 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127d1ac-5e28-4999-8c9e-edfbcb0b8fd4 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:23.036236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 444/907] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 20:25:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:25:23.046227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:23.209573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827335c-0899-47f0-8122-1138b0c31a65 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:23.256069 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a037-b0dc-49e4-a3c6-1d7422be7f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:23.256832 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a037-b0dc-49e4-a3c6-1d7422be7f13 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:23.257340 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a037-b0dc-49e4-a3c6-1d7422be7f13 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:23.258455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a037-b0dc-49e4-a3c6-1d7422be7f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:23.259340 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a037-b0dc-49e4-a3c6-1d7422be7f13 None admin] RBAC: Adding query filter params (role.id=671de95ce54744059ab540d90d3b40ce, scope.project.id=fcba1bed6cbb44dd8da5613751435133, user.id=6e44d14442bf41598e92099a4bd9ace2) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:23.259666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a037-b0dc-49e4-a3c6-1d7422be7f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:23.261547 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a037-b0dc-49e4-a3c6-1d7422be7f13 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:23.269178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 464/908] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 20:25:23 2022] GET /identity/v3/role_assignments?user.id=6e44d14442bf41598e92099a4bd9ace2&scope.project.id=fcba1bed6cbb44dd8da5613751435133&role.id=671de95ce54744059ab540d90d3b40ce => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:26.535329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5404a-ef8c-46e4-8df8-806069ef2dca None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:26.536042 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5404a-ef8c-46e4-8df8-806069ef2dca None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:26.536309 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5404a-ef8c-46e4-8df8-806069ef2dca None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:26.538742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 445/909] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:25:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:25:26.547235 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73814cd5-c299-44d7-b192-fa653ac2c845 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:26.548070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73814cd5-c299-44d7-b192-fa653ac2c845 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:26.548070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73814cd5-c299-44d7-b192-fa653ac2c845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:26.571207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-73814cd5-c299-44d7-b192-fa653ac2c845 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:25:26.572751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-73814cd5-c299-44d7-b192-fa653ac2c845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:25:26.615514 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:26.667454 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 465/910] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:25:26 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:25:26.694688 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5404a-ef8c-46e4-8df8-806069ef2dca None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:26.847520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5404a-ef8c-46e4-8df8-806069ef2dca None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:26.862573 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:26.919604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:26.920786 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:26.921331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:26.921829 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:26.923057 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:26.925375 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:26.943158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:26.945867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:26.948826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:26.949914 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 446/911] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Jul 25 20:25:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 20:25:26.954521 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73814cd5-c299-44d7-b192-fa653ac2c845 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:27.112790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73814cd5-c299-44d7-b192-fa653ac2c845 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:27.156046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8270e55-bfac-460f-be65-abd536475910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:27.156676 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8270e55-bfac-460f-be65-abd536475910 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:27.156967 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8270e55-bfac-460f-be65-abd536475910 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:27.157278 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8270e55-bfac-460f-be65-abd536475910 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:27.157978 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8270e55-bfac-460f-be65-abd536475910 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:27.158284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8270e55-bfac-460f-be65-abd536475910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:27.159679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8270e55-bfac-460f-be65-abd536475910 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:27.165673 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 466/912] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Jul 25 20:25:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:27.172655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:27.300076 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091cf0f-cd1c-412f-9179-2b9d5ecb124a None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:27.358831 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8c3ca-b629-4a1a-8fb3-c28428523e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:27.359931 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8c3ca-b629-4a1a-8fb3-c28428523e66 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:27.360442 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8c3ca-b629-4a1a-8fb3-c28428523e66 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:27.360951 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8c3ca-b629-4a1a-8fb3-c28428523e66 None admin] PATH_INFO: `/v3/services` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:27.362334 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8c3ca-b629-4a1a-8fb3-c28428523e66 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:27.362991 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8c3ca-b629-4a1a-8fb3-c28428523e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:27.365252 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8c3ca-b629-4a1a-8fb3-c28428523e66 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:27.375316 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 447/913] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Jul 25 20:25:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:30.598322 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655a2f-ddca-438b-976b-9293b1eefdb0 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:30.599245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655a2f-ddca-438b-976b-9293b1eefdb0 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:30.599245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655a2f-ddca-438b-976b-9293b1eefdb0 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:30.600903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 467/914] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:25:30.609095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf24ed-1e44-4d27-a0f6-e9c170e5134f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:30.609748 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf24ed-1e44-4d27-a0f6-e9c170e5134f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:30.610019 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf24ed-1e44-4d27-a0f6-e9c170e5134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:30.640627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-cacf24ed-1e44-4d27-a0f6-e9c170e5134f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:25:30.642833 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-cacf24ed-1e44-4d27-a0f6-e9c170e5134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:25:30.698297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:30.760240 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 448/915] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:25:30 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:25:30.786498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655a2f-ddca-438b-976b-9293b1eefdb0 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:30.835982 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:30.968518 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655a2f-ddca-438b-976b-9293b1eefdb0 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:31.021940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c632e88-163c-4722-aac9-39f4c30c4ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:31.023138 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632e88-163c-4722-aac9-39f4c30c4ca1 None admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:31.023644 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632e88-163c-4722-aac9-39f4c30c4ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:31.024147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c632e88-163c-4722-aac9-39f4c30c4ca1 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:31.025480 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c632e88-163c-4722-aac9-39f4c30c4ca1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:31.028203 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c632e88-163c-4722-aac9-39f4c30c4ca1 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:31.052164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 468/916] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 20:25:30 2022] POST /identity/v3/services => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:25:33.761975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc256a-8ab7-4e05-95d1-2e6519a6142a None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:33.762784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc256a-8ab7-4e05-95d1-2e6519a6142a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:33.762784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc256a-8ab7-4e05-95d1-2e6519a6142a None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:33.764376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 449/917] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:25:33.770658 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a12a1-292d-4a62-a1e4-8126cefec374 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:33.771276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a12a1-292d-4a62-a1e4-8126cefec374 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:33.771276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a12a1-292d-4a62-a1e4-8126cefec374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:33.797785 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ec9a12a1-292d-4a62-a1e4-8126cefec374 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:25:33.799847 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ec9a12a1-292d-4a62-a1e4-8126cefec374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:25:33.911821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 469/918] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:25:33 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 20:25:33.960277 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc256a-8ab7-4e05-95d1-2e6519a6142a None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:34.099606 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc256a-8ab7-4e05-95d1-2e6519a6142a None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:34.154267 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:34.155074 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:34.155415 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:34.155848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] PATH_INFO: `/v3/services/placement` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:34.156953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:34.159464 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:34.173657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:34.181656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:34.183300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 450/919] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Jul 25 20:25:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:34.186543 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a12a1-292d-4a62-a1e4-8126cefec374 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:34.225609 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:34.381528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a12a1-292d-4a62-a1e4-8126cefec374 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:34.429838 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:34.431021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:34.431446 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:34.432018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:34.432871 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:34.433464 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:34.435447 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:34.442063 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 470/920] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Jul 25 20:25:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:34.452176 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:34.493767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:34.605693 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc9cd-23fd-4de4-ba1b-f6d464b07d0d None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:34.670258 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228262-ffbc-481d-85a0-99d89727272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:34.670810 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228262-ffbc-481d-85a0-99d89727272e None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:34.671093 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228262-ffbc-481d-85a0-99d89727272e None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:34.671369 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228262-ffbc-481d-85a0-99d89727272e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:34.672163 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228262-ffbc-481d-85a0-99d89727272e None admin] RBAC: Adding query filter params (interface=public, service_id=d5945b9f226748b88f09ff80e368baec, region_id=RegionOne) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:34.672569 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228262-ffbc-481d-85a0-99d89727272e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:34.674241 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228262-ffbc-481d-85a0-99d89727272e None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:34.681963 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 451/921] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 20:25:34 2022] GET /identity/v3/endpoints?service_id=d5945b9f226748b88f09ff80e368baec&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:34.689417 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:34.824969 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:34.862903 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c42bb-d1e5-4348-80b6-e1b88faca7c3 None admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:34.930826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc2315-0546-4010-a52f-b7facbaf537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:34.931788 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc2315-0546-4010-a52f-b7facbaf537f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:34.932270 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc2315-0546-4010-a52f-b7facbaf537f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:34.932762 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc2315-0546-4010-a52f-b7facbaf537f None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:34.934056 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc2315-0546-4010-a52f-b7facbaf537f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:34.936574 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc2315-0546-4010-a52f-b7facbaf537f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:34.950345 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 471/922] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 20:25:34 2022] GET /identity/v3/services => generated 1962 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:25:37.629515 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0ac84-2d24-4e83-9a50-9d55dd97f75c None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:37.630201 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0ac84-2d24-4e83-9a50-9d55dd97f75c None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:37.630496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0ac84-2d24-4e83-9a50-9d55dd97f75c None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:37.633917 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 452/923] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:25:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:25:37.644569 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d562c2-e54b-490d-b1b0-185dafa5d55c None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:37.645478 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d562c2-e54b-490d-b1b0-185dafa5d55c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:37.645639 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d562c2-e54b-490d-b1b0-185dafa5d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:37.678795 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-86d562c2-e54b-490d-b1b0-185dafa5d55c None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:25:37.682470 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-86d562c2-e54b-490d-b1b0-185dafa5d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:25:37.807036 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 472/924] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:25:37 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 20:25:37.838897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0ac84-2d24-4e83-9a50-9d55dd97f75c None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:38.008388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:38.028950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0ac84-2d24-4e83-9a50-9d55dd97f75c None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:38.082183 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:38.083233 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:38.083677 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:38.084105 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:38.085159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:38.088268 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 20:25:38.106553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 20:25:38.108630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application with Lock( Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self._enter() Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application return self.creator() Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application created_value = creator( Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: ERROR keystone.server.flask.application Jul 25 20:25:38.110538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 453/925] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Jul 25 20:25:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 20:25:38.118992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d562c2-e54b-490d-b1b0-185dafa5d55c None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:38.230820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:38.273990 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d562c2-e54b-490d-b1b0-185dafa5d55c None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:38.329891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03a2de-4c84-4fa9-836d-4d9edec42a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:38.330598 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03a2de-4c84-4fa9-836d-4d9edec42a1f None admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:38.330934 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03a2de-4c84-4fa9-836d-4d9edec42a1f None admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:38.331269 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03a2de-4c84-4fa9-836d-4d9edec42a1f None admin] PATH_INFO: `/v3/services` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:38.332062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03a2de-4c84-4fa9-836d-4d9edec42a1f None admin] RBAC: Adding query filter params (name=placement) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:25:38.332430 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03a2de-4c84-4fa9-836d-4d9edec42a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:38.334002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03a2de-4c84-4fa9-836d-4d9edec42a1f None admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:38.341358 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 473/926] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Jul 25 20:25:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:25:38.347871 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:25:38.491767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1abc56-cb54-4b57-bd97-cb6f0c03ed37 None admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:25:38.548780 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7c0fa-455b-47d1-aa30-1ec3fddac6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:25:38.549541 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c0fa-455b-47d1-aa30-1ec3fddac6b6 None admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:25:38.549857 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c0fa-455b-47d1-aa30-1ec3fddac6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:25:38.550104 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c0fa-455b-47d1-aa30-1ec3fddac6b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:25:38.551049 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7c0fa-455b-47d1-aa30-1ec3fddac6b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:25:38.552619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7c0fa-455b-47d1-aa30-1ec3fddac6b6 None admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:25:38.579508 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 454/927] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:25:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:25:48.337877 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=30 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:48.578378 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:57.049515 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16315d1-bfc2-4000-8c12-86d6160cd555 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:26:57.050267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16315d1-bfc2-4000-8c12-86d6160cd555 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:26:57.050423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16315d1-bfc2-4000-8c12-86d6160cd555 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:26:57.062577 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5f7de-2c2d-400d-8f8c-4e93fc4b8d9f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:26:57.063225 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5f7de-2c2d-400d-8f8c-4e93fc4b8d9f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:26:57.063379 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5f7de-2c2d-400d-8f8c-4e93fc4b8d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:26:57.068370 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 474/928] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:26:57 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:26:57.106416 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-d2f5f7de-2c2d-400d-8f8c-4e93fc4b8d9f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:26:57.108879 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-d2f5f7de-2c2d-400d-8f8c-4e93fc4b8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:26:57.347009 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 455/929] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:26:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:26:57.391018 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615af53-a6d8-45fb-8903-a4b83a6e1df3 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:26:57.391496 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615af53-a6d8-45fb-8903-a4b83a6e1df3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:26:57.391864 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615af53-a6d8-45fb-8903-a4b83a6e1df3 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:26:57.393907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 475/930] 10.222.0.47 () {54 vars in 965 bytes} [Mon Jul 25 20:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:26:57.402915 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64e513-7303-498d-b957-12c4e202884a None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:26:57.403518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64e513-7303-498d-b957-12c4e202884a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:26:57.404028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64e513-7303-498d-b957-12c4e202884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:26:57.498166 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-ee64e513-7303-498d-b957-12c4e202884a None None] MFA Rules not processed for user `c82c5960cd2a459495388eb5fb1b1cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:26:57.500315 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ee64e513-7303-498d-b957-12c4e202884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:26:57.613346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 456/931] 10.222.0.47 () {58 vars in 1062 bytes} [Mon Jul 25 20:26:57 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:26:57.621244 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615af53-a6d8-45fb-8903-a4b83a6e1df3 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:26:57.634523 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615af53-a6d8-45fb-8903-a4b83a6e1df3 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:26:57.639025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2dc4-a4f5-4ed4-885a-c6760d7e0092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:26:57.639926 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2dc4-a4f5-4ed4-885a-c6760d7e0092 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:26:57.640397 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2dc4-a4f5-4ed4-885a-c6760d7e0092 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:26:57.640858 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2dc4-a4f5-4ed4-885a-c6760d7e0092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:26:57.654112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff2dc4-a4f5-4ed4-885a-c6760d7e0092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:26:57.655891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff2dc4-a4f5-4ed4-885a-c6760d7e0092 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:26:57.676096 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 476/932] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:26:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:00.856847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e53cdc-81e7-4ef8-b22e-6b06dc69a075 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:00.856847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e53cdc-81e7-4ef8-b22e-6b06dc69a075 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:00.856847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e53cdc-81e7-4ef8-b22e-6b06dc69a075 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:00.861210 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 457/933] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:00.866577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fd8e1-ae2b-4982-a07e-e7707a57630b None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:00.867373 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fd8e1-ae2b-4982-a07e-e7707a57630b None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:00.867373 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fd8e1-ae2b-4982-a07e-e7707a57630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:00.906627 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-df2fd8e1-ae2b-4982-a07e-e7707a57630b None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:00.908640 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-df2fd8e1-ae2b-4982-a07e-e7707a57630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:00.924035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 477/934] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:01.012462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01fbee-059d-4402-b8da-9a3a51c61951 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:01.013088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01fbee-059d-4402-b8da-9a3a51c61951 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:01.013731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01fbee-059d-4402-b8da-9a3a51c61951 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:01.016548 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 458/935] 10.222.0.47 () {54 vars in 965 bytes} [Mon Jul 25 20:27:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:01.028943 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6284970-9b71-4faa-8de0-b54731056ee9 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:01.029626 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6284970-9b71-4faa-8de0-b54731056ee9 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:01.030114 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6284970-9b71-4faa-8de0-b54731056ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:01.072827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-b6284970-9b71-4faa-8de0-b54731056ee9 None None] MFA Rules not processed for user `c82c5960cd2a459495388eb5fb1b1cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:01.075291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-b6284970-9b71-4faa-8de0-b54731056ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:01.088145 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 478/936] 10.222.0.47 () {58 vars in 1062 bytes} [Mon Jul 25 20:27:01 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:01.103687 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01fbee-059d-4402-b8da-9a3a51c61951 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:01.118540 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01fbee-059d-4402-b8da-9a3a51c61951 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:01.123192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a16dc-003e-4513-b71c-0ed5ab064807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:01.124018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a16dc-003e-4513-b71c-0ed5ab064807 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:01.124432 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a16dc-003e-4513-b71c-0ed5ab064807 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:01.124837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a16dc-003e-4513-b71c-0ed5ab064807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:01.138802 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a16dc-003e-4513-b71c-0ed5ab064807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:01.140655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a16dc-003e-4513-b71c-0ed5ab064807 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:01.154276 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 459/937] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:27:05.294034 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca28bf-a02e-46f2-8a99-d2b1755f16c9 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:05.294796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca28bf-a02e-46f2-8a99-d2b1755f16c9 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:05.294796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca28bf-a02e-46f2-8a99-d2b1755f16c9 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:05.296318 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 479/938] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:05.304450 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987586-f82c-4702-909b-ee6c0cca2b6d None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:05.305307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987586-f82c-4702-909b-ee6c0cca2b6d None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:05.305307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e987586-f82c-4702-909b-ee6c0cca2b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:05.376799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-0e987586-f82c-4702-909b-ee6c0cca2b6d None None] MFA Rules not processed for user `6a99665654ad4c7ea175df20f2ac945d`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:05.379200 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-0e987586-f82c-4702-909b-ee6c0cca2b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:05.472503 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:05.537203 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 460/939] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:05 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:05.608025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca28bf-a02e-46f2-8a99-d2b1755f16c9 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:05.627082 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca28bf-a02e-46f2-8a99-d2b1755f16c9 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:05.635047 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56917f9-4a27-4268-aad9-a72087d927f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:05.639721 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56917f9-4a27-4268-aad9-a72087d927f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:05.640196 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56917f9-4a27-4268-aad9-a72087d927f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:05.640585 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56917f9-4a27-4268-aad9-a72087d927f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:05.655629 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56917f9-4a27-4268-aad9-a72087d927f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:05.659140 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56917f9-4a27-4268-aad9-a72087d927f4 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:05.680178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 480/940] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:05 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:10.769196 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcb7a4-7bf3-4748-b5de-dac51411e4a1 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:10.769851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcb7a4-7bf3-4748-b5de-dac51411e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:10.769851 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcb7a4-7bf3-4748-b5de-dac51411e4a1 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:10.772234 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 461/941] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:10.779198 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f72184-d31c-460e-bf14-41a34fc7527c None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:10.780068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f72184-d31c-460e-bf14-41a34fc7527c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:10.780068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f72184-d31c-460e-bf14-41a34fc7527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:10.803305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-e6f72184-d31c-460e-bf14-41a34fc7527c None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:10.804653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-e6f72184-d31c-460e-bf14-41a34fc7527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:10.896612 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 481/942] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:10 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:10.941362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcb7a4-7bf3-4748-b5de-dac51411e4a1 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:10.953889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcb7a4-7bf3-4748-b5de-dac51411e4a1 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:10.957839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b74dff-cf07-4703-9111-b643755740c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:10.958489 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b74dff-cf07-4703-9111-b643755740c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:10.958883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b74dff-cf07-4703-9111-b643755740c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:10.959752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b74dff-cf07-4703-9111-b643755740c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:10.969565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b74dff-cf07-4703-9111-b643755740c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:10.971057 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b74dff-cf07-4703-9111-b643755740c7 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:10.982995 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 462/943] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:10 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:27:15.247926 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2e780-eeeb-462b-8cd3-a5d2bed2e2ff None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:15.248834 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2e780-eeeb-462b-8cd3-a5d2bed2e2ff None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:15.249002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2e780-eeeb-462b-8cd3-a5d2bed2e2ff None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:15.251750 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 482/944] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:15.260702 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e6ec0-934a-424d-aaa7-ee1e634a9f7f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:15.261584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e6ec0-934a-424d-aaa7-ee1e634a9f7f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:15.261584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e6ec0-934a-424d-aaa7-ee1e634a9f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:15.292837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-1c6e6ec0-934a-424d-aaa7-ee1e634a9f7f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:15.294243 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-1c6e6ec0-934a-424d-aaa7-ee1e634a9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:15.303423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 463/945] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:15.345453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2e780-eeeb-462b-8cd3-a5d2bed2e2ff None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:15.359009 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2e780-eeeb-462b-8cd3-a5d2bed2e2ff None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:15.363581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41ee34-b514-4de0-a8f2-60d95762cd09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:15.364456 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ee34-b514-4de0-a8f2-60d95762cd09 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:15.364928 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ee34-b514-4de0-a8f2-60d95762cd09 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:15.365377 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ee34-b514-4de0-a8f2-60d95762cd09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:15.377247 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ee34-b514-4de0-a8f2-60d95762cd09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:15.378962 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ee34-b514-4de0-a8f2-60d95762cd09 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:15.391011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 483/946] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:18.062854 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313f0c-21a1-40ce-94d7-13db8c00ccb1 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:18.063639 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313f0c-21a1-40ce-94d7-13db8c00ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:18.063639 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313f0c-21a1-40ce-94d7-13db8c00ccb1 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:18.065859 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 464/947] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:27:18.076441 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994735-581b-482c-a8ed-17fc6b6f284a None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:18.077134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994735-581b-482c-a8ed-17fc6b6f284a None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:18.077505 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994735-581b-482c-a8ed-17fc6b6f284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:18.106346 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-f7994735-581b-482c-a8ed-17fc6b6f284a None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:18.108062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-f7994735-581b-482c-a8ed-17fc6b6f284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:18.123056 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 484/948] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:18.170320 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c313f0c-21a1-40ce-94d7-13db8c00ccb1 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:18.184346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c313f0c-21a1-40ce-94d7-13db8c00ccb1 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:18.189209 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fdb3c-28d1-4dc1-b473-e122bd0f0dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:18.190072 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fdb3c-28d1-4dc1-b473-e122bd0f0dbc service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:18.190514 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fdb3c-28d1-4dc1-b473-e122bd0f0dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:18.190916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fdb3c-28d1-4dc1-b473-e122bd0f0dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:18.209527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fdb3c-28d1-4dc1-b473-e122bd0f0dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:18.212297 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fdb3c-28d1-4dc1-b473-e122bd0f0dbc service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:18.231661 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 465/949] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:20.818923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc570f-2acf-4c51-8901-20a2151ac8cd None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:20.819497 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc570f-2acf-4c51-8901-20a2151ac8cd None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:20.819497 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc570f-2acf-4c51-8901-20a2151ac8cd None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:20.821219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 485/950] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:20.828804 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4698-4985-4cbc-abc0-35b016faae97 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:20.829548 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4698-4985-4cbc-abc0-35b016faae97 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:20.829839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4698-4985-4cbc-abc0-35b016faae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:20.868962 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-9dbe4698-4985-4cbc-abc0-35b016faae97 None None] MFA Rules not processed for user `6a99665654ad4c7ea175df20f2ac945d`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:20.871172 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-9dbe4698-4985-4cbc-abc0-35b016faae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:20.885822 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 466/951] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:20 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:20.935752 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc570f-2acf-4c51-8901-20a2151ac8cd None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:20.942096 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=59 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:20.950209 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc570f-2acf-4c51-8901-20a2151ac8cd None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:20.954800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55537e9a-ae6e-40e8-954f-f2ce3fe8f85d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:20.955550 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537e9a-ae6e-40e8-954f-f2ce3fe8f85d service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:20.955904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537e9a-ae6e-40e8-954f-f2ce3fe8f85d service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:20.956257 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537e9a-ae6e-40e8-954f-f2ce3fe8f85d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:20.968046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537e9a-ae6e-40e8-954f-f2ce3fe8f85d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:20.969672 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537e9a-ae6e-40e8-954f-f2ce3fe8f85d service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:20.982079 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 486/952] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:20 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:24.662735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbcd0e-ac58-4c2e-811b-dd61f4f0a131 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:24.663496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbcd0e-ac58-4c2e-811b-dd61f4f0a131 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:24.663496 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbcd0e-ac58-4c2e-811b-dd61f4f0a131 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:24.664734 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 467/953] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:27:24.672992 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5af82-797d-48fb-a800-9fab7877fc8d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:24.673767 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5af82-797d-48fb-a800-9fab7877fc8d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:24.674122 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5af82-797d-48fb-a800-9fab7877fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:24.713136 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-e4b5af82-797d-48fb-a800-9fab7877fc8d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:24.715112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-e4b5af82-797d-48fb-a800-9fab7877fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:24.731143 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 487/954] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:24.815841 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbcd0e-ac58-4c2e-811b-dd61f4f0a131 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:24.836499 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbcd0e-ac58-4c2e-811b-dd61f4f0a131 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:24.844526 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f179-f48b-421d-9b1f-2666f537f0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:24.845667 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f179-f48b-421d-9b1f-2666f537f0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:24.846159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f179-f48b-421d-9b1f-2666f537f0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:24.846639 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f179-f48b-421d-9b1f-2666f537f0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:24.866056 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f179-f48b-421d-9b1f-2666f537f0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:24.868916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f179-f48b-421d-9b1f-2666f537f0d3 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:24.888860 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 468/955] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:28.065323 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649c88-5a2b-4324-b971-94b6ffc050fc None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:28.065323 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649c88-5a2b-4324-b971-94b6ffc050fc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:28.065323 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649c88-5a2b-4324-b971-94b6ffc050fc None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:28.067472 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 488/956] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:27:28.074087 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a165-2dd6-4478-9323-0351d7957f06 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:28.074940 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a165-2dd6-4478-9323-0351d7957f06 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:28.074940 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a165-2dd6-4478-9323-0351d7957f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:28.099153 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-4329a165-2dd6-4478-9323-0351d7957f06 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:28.100752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-4329a165-2dd6-4478-9323-0351d7957f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:28.115037 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 469/957] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:27:28.179581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649c88-5a2b-4324-b971-94b6ffc050fc None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:28.192001 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649c88-5a2b-4324-b971-94b6ffc050fc None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:28.196577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c4af-c5f0-4ede-98dd-fc5eb4558b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:28.197321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c4af-c5f0-4ede-98dd-fc5eb4558b81 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:28.197725 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c4af-c5f0-4ede-98dd-fc5eb4558b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:28.198087 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c4af-c5f0-4ede-98dd-fc5eb4558b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:28.210328 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c4af-c5f0-4ede-98dd-fc5eb4558b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:28.212065 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c4af-c5f0-4ede-98dd-fc5eb4558b81 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:28.225947 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 489/958] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:27:32.449225 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635e00c-d992-474e-a210-e6945415e81c None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:32.450107 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635e00c-d992-474e-a210-e6945415e81c None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:32.450107 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635e00c-d992-474e-a210-e6945415e81c None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:32.451338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 470/959] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:32.458098 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c493c-0f03-4e12-84cc-eb525974581d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:32.458813 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c493c-0f03-4e12-84cc-eb525974581d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:32.458813 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c493c-0f03-4e12-84cc-eb525974581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:32.480786 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-680c493c-0f03-4e12-84cc-eb525974581d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:32.482296 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-680c493c-0f03-4e12-84cc-eb525974581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:32.491483 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 490/960] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:32 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:27:32.533331 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635e00c-d992-474e-a210-e6945415e81c None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:32.548212 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635e00c-d992-474e-a210-e6945415e81c None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:32.553152 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeefd9a-6bc6-40f8-ac56-5c71e0789cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:32.553794 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeefd9a-6bc6-40f8-ac56-5c71e0789cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:32.554073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeefd9a-6bc6-40f8-ac56-5c71e0789cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:32.554344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeefd9a-6bc6-40f8-ac56-5c71e0789cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:32.568258 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeefd9a-6bc6-40f8-ac56-5c71e0789cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:32.570887 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeefd9a-6bc6-40f8-ac56-5c71e0789cd5 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:32.588783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 471/961] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:32 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:39.062255 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b43e5-a031-4357-8e83-467a1e0a6a16 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:39.063091 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b43e5-a031-4357-8e83-467a1e0a6a16 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:39.063210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b43e5-a031-4357-8e83-467a1e0a6a16 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:39.065675 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 491/962] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:39.075636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48391c4-20ef-4126-bab7-31a48b0cf866 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:39.076232 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48391c4-20ef-4126-bab7-31a48b0cf866 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:39.076870 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48391c4-20ef-4126-bab7-31a48b0cf866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:39.088553 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=45 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:39.104220 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-c48391c4-20ef-4126-bab7-31a48b0cf866 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:39.105545 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-c48391c4-20ef-4126-bab7-31a48b0cf866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:39.114932 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 472/963] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:39.165442 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b43e5-a031-4357-8e83-467a1e0a6a16 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:39.186209 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b43e5-a031-4357-8e83-467a1e0a6a16 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:39.192964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28ba6-4958-4c89-9fe5-8b02da3e8d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:39.194067 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28ba6-4958-4c89-9fe5-8b02da3e8d1a service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:39.194552 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28ba6-4958-4c89-9fe5-8b02da3e8d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:39.195046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28ba6-4958-4c89-9fe5-8b02da3e8d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:39.213128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28ba6-4958-4c89-9fe5-8b02da3e8d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:39.215957 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28ba6-4958-4c89-9fe5-8b02da3e8d1a service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:39.235564 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 492/964] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:43.921327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673f47-2581-41e7-945a-36e20ee38706 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:43.921979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673f47-2581-41e7-945a-36e20ee38706 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:43.921979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673f47-2581-41e7-945a-36e20ee38706 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:43.923327 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 473/965] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:43.930369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee5a1b-47ce-44d2-a0a0-b600370c450a None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:43.931068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee5a1b-47ce-44d2-a0a0-b600370c450a None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:43.931068 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee5a1b-47ce-44d2-a0a0-b600370c450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:43.954645 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-d6ee5a1b-47ce-44d2-a0a0-b600370c450a None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:43.956178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-d6ee5a1b-47ce-44d2-a0a0-b600370c450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:43.965491 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 493/966] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:43 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:44.011564 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e673f47-2581-41e7-945a-36e20ee38706 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:44.023849 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e673f47-2581-41e7-945a-36e20ee38706 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:44.027627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070a3d-0dfe-49b8-b2b9-d859b70e9b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:44.028260 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070a3d-0dfe-49b8-b2b9-d859b70e9b41 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:44.028543 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070a3d-0dfe-49b8-b2b9-d859b70e9b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:44.028825 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070a3d-0dfe-49b8-b2b9-d859b70e9b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:44.042072 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070a3d-0dfe-49b8-b2b9-d859b70e9b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:44.043972 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070a3d-0dfe-49b8-b2b9-d859b70e9b41 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:44.062350 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 474/967] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:44 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:49.500374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b502d-4242-41d0-982e-eb2caf428a0e None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:49.501284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b502d-4242-41d0-982e-eb2caf428a0e None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:49.501284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b502d-4242-41d0-982e-eb2caf428a0e None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:49.502419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 494/968] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:49.510888 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768990-0ae3-42a2-a727-6642990d35c4 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:49.511732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768990-0ae3-42a2-a727-6642990d35c4 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:49.511907 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768990-0ae3-42a2-a727-6642990d35c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:49.549445 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-35768990-0ae3-42a2-a727-6642990d35c4 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:49.552634 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-35768990-0ae3-42a2-a727-6642990d35c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:49.568231 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 475/969] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:27:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:49.642002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b502d-4242-41d0-982e-eb2caf428a0e None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:27:49.662919 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b502d-4242-41d0-982e-eb2caf428a0e None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:27:49.669733 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5d5c5-8726-4624-aedd-fdbe708003ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:27:49.670828 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d5c5-8726-4624-aedd-fdbe708003ec service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:49.671371 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d5c5-8726-4624-aedd-fdbe708003ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:49.671859 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d5c5-8726-4624-aedd-fdbe708003ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:49.691270 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5d5c5-8726-4624-aedd-fdbe708003ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:27:49.694502 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5d5c5-8726-4624-aedd-fdbe708003ec service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:27:49.715095 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 495/970] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:27:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:27:57.429874 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44732-d918-4c2b-ae62-50436fee48f0 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:57.430923 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44732-d918-4c2b-ae62-50436fee48f0 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:57.431211 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44732-d918-4c2b-ae62-50436fee48f0 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:57.434370 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 476/971] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 20:27:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:27:57.441478 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcfc4-0fac-4f7b-885b-92286b3b1415 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:27:57.442031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcfc4-0fac-4f7b-885b-92286b3b1415 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:27:57.442461 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcfc4-0fac-4f7b-885b-92286b3b1415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:27:57.455475 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=33 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:57.540846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-252dcfc4-0fac-4f7b-885b-92286b3b1415 None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:27:57.542679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-252dcfc4-0fac-4f7b-885b-92286b3b1415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:27:57.651649 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 496/972] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 20:27:57 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:27:59.540807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=11 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:04.845518 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86b8b-61ea-47cf-9952-6d05afed90ac None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:04.847004 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86b8b-61ea-47cf-9952-6d05afed90ac None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:04.847782 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86b8b-61ea-47cf-9952-6d05afed90ac None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:04.851103 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 477/973] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 20:28:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:04.859650 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e021-8316-4864-8e88-39c757bb327d None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:04.860293 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e021-8316-4864-8e88-39c757bb327d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:04.860906 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e021-8316-4864-8e88-39c757bb327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:04.900296 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-5bd8e021-8316-4864-8e88-39c757bb327d None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:04.902724 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-5bd8e021-8316-4864-8e88-39c757bb327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:04.919131 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 497/974] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 20:28:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:06.883419 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27654d-8d7c-433f-b91a-85575c5eebe6 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:06.884162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27654d-8d7c-433f-b91a-85575c5eebe6 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:06.884162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27654d-8d7c-433f-b91a-85575c5eebe6 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:06.885436 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 478/975] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 20:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:28:06.891558 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071324d-34a3-4201-9b67-eaffd88cbce3 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:06.892155 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071324d-34a3-4201-9b67-eaffd88cbce3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:06.892341 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071324d-34a3-4201-9b67-eaffd88cbce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:07.051159 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-7071324d-34a3-4201-9b67-eaffd88cbce3 None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:07.052721 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-7071324d-34a3-4201-9b67-eaffd88cbce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:07.062528 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 498/976] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 20:28:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:28:12.331889 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783b03b-5563-4555-98d6-a1f8aa6114ce None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:12.332546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783b03b-5563-4555-98d6-a1f8aa6114ce None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:12.332546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783b03b-5563-4555-98d6-a1f8aa6114ce None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:12.334023 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 479/977] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:28:12.342801 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee84b-10c4-4136-bc14-da6e6e4fd5b0 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:12.343721 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee84b-10c4-4136-bc14-da6e6e4fd5b0 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:12.343721 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee84b-10c4-4136-bc14-da6e6e4fd5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:12.381537 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-94dee84b-10c4-4136-bc14-da6e6e4fd5b0 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:12.383682 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-94dee84b-10c4-4136-bc14-da6e6e4fd5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:12.395056 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 499/978] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:12.469672 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998baf42-15a0-45f5-80b9-49bbc0fc72ba None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:12.470478 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998baf42-15a0-45f5-80b9-49bbc0fc72ba None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:12.471494 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998baf42-15a0-45f5-80b9-49bbc0fc72ba None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:12.473643 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 480/979] 10.222.0.47 () {54 vars in 962 bytes} [Mon Jul 25 20:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:28:12.486591 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebda68-a71f-4d43-99c7-220a78534712 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:12.487760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebda68-a71f-4d43-99c7-220a78534712 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:12.488595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebda68-a71f-4d43-99c7-220a78534712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:12.568203 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-f7ebda68-a71f-4d43-99c7-220a78534712 None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:12.570058 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-f7ebda68-a71f-4d43-99c7-220a78534712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:12.730601 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 500/980] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Jul 25 20:28:12 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:28:12.744054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998baf42-15a0-45f5-80b9-49bbc0fc72ba None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:12.782690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998baf42-15a0-45f5-80b9-49bbc0fc72ba None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:12.795097 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1fba8-e336-42a2-ae0d-472496223f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:12.796187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1fba8-e336-42a2-ae0d-472496223f6b service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:12.796683 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1fba8-e336-42a2-ae0d-472496223f6b service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:12.797299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1fba8-e336-42a2-ae0d-472496223f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:12.814054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1fba8-e336-42a2-ae0d-472496223f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:12.817312 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1fba8-e336-42a2-ae0d-472496223f6b service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:12.838115 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 481/981] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:28:17.228697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892663d-6459-450b-bb52-54f385b2f52b None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:17.229526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892663d-6459-450b-bb52-54f385b2f52b None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:17.229526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892663d-6459-450b-bb52-54f385b2f52b None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:17.232721 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 501/982] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:17.237195 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc85fb-87b3-4fb4-8822-64d60069a028 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:17.238014 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc85fb-87b3-4fb4-8822-64d60069a028 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:17.238014 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc85fb-87b3-4fb4-8822-64d60069a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:17.260159 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-f9bc85fb-87b3-4fb4-8822-64d60069a028 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:17.261497 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-f9bc85fb-87b3-4fb4-8822-64d60069a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:17.271136 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 482/983] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:28:17.356571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892663d-6459-450b-bb52-54f385b2f52b None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:17.380487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892663d-6459-450b-bb52-54f385b2f52b None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:17.388693 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8782d7-fa90-4e80-80dc-9b7ff0e38aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:17.389879 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8782d7-fa90-4e80-80dc-9b7ff0e38aae service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:17.390403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8782d7-fa90-4e80-80dc-9b7ff0e38aae service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:17.390941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8782d7-fa90-4e80-80dc-9b7ff0e38aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:17.406512 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8782d7-fa90-4e80-80dc-9b7ff0e38aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:17.410076 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8782d7-fa90-4e80-80dc-9b7ff0e38aae service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:17.430763 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 502/984] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:21.547258 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf2e8f-693d-4860-be79-dcfb9cf64212 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:21.548149 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf2e8f-693d-4860-be79-dcfb9cf64212 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:21.548149 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf2e8f-693d-4860-be79-dcfb9cf64212 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:21.550839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 483/985] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:21.557090 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37a0b-d04c-4d94-9b48-3f2dcde5150c None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:21.558089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37a0b-d04c-4d94-9b48-3f2dcde5150c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:21.558089 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37a0b-d04c-4d94-9b48-3f2dcde5150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:21.591697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-c3b37a0b-d04c-4d94-9b48-3f2dcde5150c None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:21.594152 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-c3b37a0b-d04c-4d94-9b48-3f2dcde5150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:21.609409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 503/986] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:21.675112 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c9a7-d11a-4553-880a-99bdd8045edb None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:21.675542 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c9a7-d11a-4553-880a-99bdd8045edb None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:21.675943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c9a7-d11a-4553-880a-99bdd8045edb None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:21.677846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 484/987] 10.222.0.47 () {54 vars in 962 bytes} [Mon Jul 25 20:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:21.689074 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72cab3-ccf7-493c-9587-4246f38b352f None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:21.689074 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72cab3-ccf7-493c-9587-4246f38b352f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:21.689819 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72cab3-ccf7-493c-9587-4246f38b352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:21.718335 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-4e72cab3-ccf7-493c-9587-4246f38b352f None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:21.719709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4e72cab3-ccf7-493c-9587-4246f38b352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:21.730799 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 504/988] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Jul 25 20:28:21 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:21.738871 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807c9a7-d11a-4553-880a-99bdd8045edb None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:21.754931 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807c9a7-d11a-4553-880a-99bdd8045edb None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:21.763990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c1192-65d4-440f-a50c-d6fa44fe6400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:21.764884 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1192-65d4-440f-a50c-d6fa44fe6400 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:21.765454 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1192-65d4-440f-a50c-d6fa44fe6400 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:21.765899 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1192-65d4-440f-a50c-d6fa44fe6400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:21.779081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c1192-65d4-440f-a50c-d6fa44fe6400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:21.781187 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c1192-65d4-440f-a50c-d6fa44fe6400 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:21.795523 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 485/989] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:24.877062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd956fe-4459-4759-9722-54d2ac94234c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:24.877867 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd956fe-4459-4759-9722-54d2ac94234c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:24.878057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd956fe-4459-4759-9722-54d2ac94234c None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:24.879922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 505/990] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:24.886443 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a67f-8122-4f77-86f5-ea1c1e674a95 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:24.887483 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a67f-8122-4f77-86f5-ea1c1e674a95 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:24.887982 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a67f-8122-4f77-86f5-ea1c1e674a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:24.917429 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-6b79a67f-8122-4f77-86f5-ea1c1e674a95 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:24.919806 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-6b79a67f-8122-4f77-86f5-ea1c1e674a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:24.934176 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 486/991] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:25.019552 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd956fe-4459-4759-9722-54d2ac94234c None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:25.045748 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=100 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:25.064782 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd956fe-4459-4759-9722-54d2ac94234c None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:25.075919 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd27633-e878-44ed-ba36-81efd2354d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:25.077415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27633-e878-44ed-ba36-81efd2354d02 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:25.077944 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27633-e878-44ed-ba36-81efd2354d02 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:25.080208 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27633-e878-44ed-ba36-81efd2354d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:25.111360 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd27633-e878-44ed-ba36-81efd2354d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:25.116704 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd27633-e878-44ed-ba36-81efd2354d02 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:25.141728 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 506/992] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:27.526931 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6895df-e927-47e1-8052-614428417c06 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:27.528748 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6895df-e927-47e1-8052-614428417c06 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:27.530045 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6895df-e927-47e1-8052-614428417c06 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:27.543304 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 487/993] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:27 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:27.550338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58177-9308-4f79-ab50-26a70dbfc383 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:27.551283 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58177-9308-4f79-ab50-26a70dbfc383 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:27.552049 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58177-9308-4f79-ab50-26a70dbfc383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:27.598647 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-6ba58177-9308-4f79-ab50-26a70dbfc383 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:27.600765 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-6ba58177-9308-4f79-ab50-26a70dbfc383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:27.618156 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 507/994] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:28.134426 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f7d5-307a-4ece-aba3-8948fd6e9b23 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:28.135469 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f7d5-307a-4ece-aba3-8948fd6e9b23 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:28.136314 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f7d5-307a-4ece-aba3-8948fd6e9b23 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:28.139894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 488/995] 10.222.0.47 () {54 vars in 964 bytes} [Mon Jul 25 20:28:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:28.151362 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3edde-a248-4435-ad9f-14eca5c3ddb4 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:28.152400 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3edde-a248-4435-ad9f-14eca5c3ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:28.153191 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3edde-a248-4435-ad9f-14eca5c3ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:28.246713 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-7ee3edde-a248-4435-ad9f-14eca5c3ddb4 None None] MFA Rules not processed for user `79a68935bb7d41c793a288bce7fe7223`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:28.249183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-7ee3edde-a248-4435-ad9f-14eca5c3ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:28.380989 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 508/996] 10.222.0.47 () {58 vars in 1061 bytes} [Mon Jul 25 20:28:28 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:28.395994 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40f7d5-307a-4ece-aba3-8948fd6e9b23 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:28.415843 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40f7d5-307a-4ece-aba3-8948fd6e9b23 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:28.426191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9e330-3dd8-40e5-a7f0-733071928266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68935bb7d41c793a288bce7fe7223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:28.427843 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9e330-3dd8-40e5-a7f0-733071928266 service cinder] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:28.428413 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9e330-3dd8-40e5-a7f0-733071928266 service cinder] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:28.428991 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9e330-3dd8-40e5-a7f0-733071928266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:28.448723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9e330-3dd8-40e5-a7f0-733071928266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:28.451637 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9e330-3dd8-40e5-a7f0-733071928266 service cinder] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:28.471523 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 489/997] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:29.055202 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e49e-1f07-438a-b4bc-8339f9d611db None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:29.061719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e49e-1f07-438a-b4bc-8339f9d611db None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:29.061719 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e49e-1f07-438a-b4bc-8339f9d611db None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:29.071601 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b047ca0-4e8e-4fdd-90de-89220661e440 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:29.072433 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b047ca0-4e8e-4fdd-90de-89220661e440 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:29.072608 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b047ca0-4e8e-4fdd-90de-89220661e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:29.080826 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 509/998] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:29 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:29.105903 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-2b047ca0-4e8e-4fdd-90de-89220661e440 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:29.107169 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-2b047ca0-4e8e-4fdd-90de-89220661e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:29.129016 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 490/999] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:29.172109 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59e49e-1f07-438a-b4bc-8339f9d611db None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:29.190526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59e49e-1f07-438a-b4bc-8339f9d611db None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:29.197164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ffa2d-f4a6-4a26-a2ed-24093194af3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:29.198081 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ffa2d-f4a6-4a26-a2ed-24093194af3a service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:29.198256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ffa2d-f4a6-4a26-a2ed-24093194af3a service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:29.198595 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ffa2d-f4a6-4a26-a2ed-24093194af3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:29.210405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ffa2d-f4a6-4a26-a2ed-24093194af3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:29.213021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ffa2d-f4a6-4a26-a2ed-24093194af3a service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:29.227637 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 510/1000] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:32.756300 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1758-84fc-4807-b4d0-b7904b9af409 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:32.757723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1758-84fc-4807-b4d0-b7904b9af409 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:32.758196 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1758-84fc-4807-b4d0-b7904b9af409 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:32.760599 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 491/1001] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:32.770440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d435bd5-ddce-4102-9b28-134e8e1805d6 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:32.771028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d435bd5-ddce-4102-9b28-134e8e1805d6 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:32.771344 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d435bd5-ddce-4102-9b28-134e8e1805d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:32.805041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-9d435bd5-ddce-4102-9b28-134e8e1805d6 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:32.807243 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-9d435bd5-ddce-4102-9b28-134e8e1805d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:32.822142 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 511/1002] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:32.904606 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a1758-84fc-4807-b4d0-b7904b9af409 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:32.929139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a1758-84fc-4807-b4d0-b7904b9af409 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:32.942178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6300a-e40d-40e3-b59c-5eb12a4b1622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:32.943626 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6300a-e40d-40e3-b59c-5eb12a4b1622 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:32.944338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6300a-e40d-40e3-b59c-5eb12a4b1622 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:32.945000 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6300a-e40d-40e3-b59c-5eb12a4b1622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:32.967767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6300a-e40d-40e3-b59c-5eb12a4b1622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:32.972116 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6300a-e40d-40e3-b59c-5eb12a4b1622 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:33.017623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 492/1003] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:36.256372 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13e249-f5ba-4144-9f24-2455c4e880f3 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:36.257249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13e249-f5ba-4144-9f24-2455c4e880f3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:36.257416 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13e249-f5ba-4144-9f24-2455c4e880f3 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:36.260067 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 512/1004] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:36.269935 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e69322-dcb1-42fe-b576-d151970c9c31 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:36.270721 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e69322-dcb1-42fe-b576-d151970c9c31 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:36.270929 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e69322-dcb1-42fe-b576-d151970c9c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:36.305449 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-14e69322-dcb1-42fe-b576-d151970c9c31 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:36.307457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-14e69322-dcb1-42fe-b576-d151970c9c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:36.322027 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 493/1005] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:36.402431 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13e249-f5ba-4144-9f24-2455c4e880f3 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:36.427667 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13e249-f5ba-4144-9f24-2455c4e880f3 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:36.439796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b758c6-a857-4f14-8f2e-f1ccedd98f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:36.439796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b758c6-a857-4f14-8f2e-f1ccedd98f8e service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:36.439796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b758c6-a857-4f14-8f2e-f1ccedd98f8e service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:36.439796 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b758c6-a857-4f14-8f2e-f1ccedd98f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:36.455422 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b758c6-a857-4f14-8f2e-f1ccedd98f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:36.458377 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b758c6-a857-4f14-8f2e-f1ccedd98f8e service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:36.474091 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 513/1006] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:39.365622 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11610-386f-45d5-bf97-b6b0ac817a56 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:39.366442 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11610-386f-45d5-bf97-b6b0ac817a56 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:39.366592 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11610-386f-45d5-bf97-b6b0ac817a56 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:39.368966 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 494/1007] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:39.379721 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b189-603e-4f5d-bf6a-703d759890e1 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:39.380560 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b189-603e-4f5d-bf6a-703d759890e1 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:39.380710 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6b189-603e-4f5d-bf6a-703d759890e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:39.408212 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-a3f6b189-603e-4f5d-bf6a-703d759890e1 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:39.410131 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-a3f6b189-603e-4f5d-bf6a-703d759890e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:39.421557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 514/1008] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:39.483478 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11610-386f-45d5-bf97-b6b0ac817a56 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:39.508545 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11610-386f-45d5-bf97-b6b0ac817a56 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:39.517254 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa517d8-87eb-4c94-99fa-87f3710c0162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:39.518299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa517d8-87eb-4c94-99fa-87f3710c0162 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:39.518785 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa517d8-87eb-4c94-99fa-87f3710c0162 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:39.519280 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa517d8-87eb-4c94-99fa-87f3710c0162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:39.536985 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa517d8-87eb-4c94-99fa-87f3710c0162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:39.540194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa517d8-87eb-4c94-99fa-87f3710c0162 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:39.550034 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=41 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:39.569401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 495/1009] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:42.790144 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b296c-7ea1-4ed1-a5c9-0ae9cc0d3d01 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:42.791549 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b296c-7ea1-4ed1-a5c9-0ae9cc0d3d01 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:42.791549 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b296c-7ea1-4ed1-a5c9-0ae9cc0d3d01 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:42.794081 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 515/1010] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:42.803905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c13a-970a-43e7-94b6-7c529875b6fa None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:42.804868 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c13a-970a-43e7-94b6-7c529875b6fa None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:42.804868 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c13a-970a-43e7-94b6-7c529875b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:42.836579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-4101c13a-970a-43e7-94b6-7c529875b6fa None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:42.838837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-4101c13a-970a-43e7-94b6-7c529875b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:42.851530 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 496/1011] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:42.916541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b296c-7ea1-4ed1-a5c9-0ae9cc0d3d01 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:42.944730 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b296c-7ea1-4ed1-a5c9-0ae9cc0d3d01 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:42.957172 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c568c22-6609-4b08-ad96-47660c5d953a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:42.958354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568c22-6609-4b08-ad96-47660c5d953a service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:42.958868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568c22-6609-4b08-ad96-47660c5d953a service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:42.959312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c568c22-6609-4b08-ad96-47660c5d953a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:42.974223 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c568c22-6609-4b08-ad96-47660c5d953a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:42.977084 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c568c22-6609-4b08-ad96-47660c5d953a service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:42.996141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 516/1012] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:46.865584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6889-6f5f-41bd-986c-636c82bf069e None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:46.866338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6889-6f5f-41bd-986c-636c82bf069e None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:46.866591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a6889-6f5f-41bd-986c-636c82bf069e None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:46.871462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 497/1013] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:46.878455 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d9a3-8368-4dd6-9d94-210d9f939956 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:46.879438 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d9a3-8368-4dd6-9d94-210d9f939956 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:46.879438 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d9a3-8368-4dd6-9d94-210d9f939956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:46.903445 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-6262d9a3-8368-4dd6-9d94-210d9f939956 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:46.904917 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-6262d9a3-8368-4dd6-9d94-210d9f939956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:46.916637 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 517/1014] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:46.970354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a6889-6f5f-41bd-986c-636c82bf069e None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:46.987151 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a6889-6f5f-41bd-986c-636c82bf069e None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:46.993335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0be22-c392-494c-a86f-9d8b3e9b437c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:46.994175 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0be22-c392-494c-a86f-9d8b3e9b437c service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:46.994594 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0be22-c392-494c-a86f-9d8b3e9b437c service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:46.995018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0be22-c392-494c-a86f-9d8b3e9b437c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:47.006136 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0be22-c392-494c-a86f-9d8b3e9b437c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:47.008414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0be22-c392-494c-a86f-9d8b3e9b437c service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:47.020453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 498/1015] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:48.912170 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013769-e8be-498a-8550-48c457dcf9fc None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:48.913366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013769-e8be-498a-8550-48c457dcf9fc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:48.913366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013769-e8be-498a-8550-48c457dcf9fc None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:48.914432 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 518/1016] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:48.921925 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf594a-478f-46cb-96e0-98ba5f54cb38 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:48.923924 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf594a-478f-46cb-96e0-98ba5f54cb38 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:48.923924 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf594a-478f-46cb-96e0-98ba5f54cb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:48.961010 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-4daf594a-478f-46cb-96e0-98ba5f54cb38 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:48.963232 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-4daf594a-478f-46cb-96e0-98ba5f54cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:48.978009 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 499/1017] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:49.097274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a322-58ed-4dff-a7c7-5a34fe88bbaa None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:49.097747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a322-58ed-4dff-a7c7-5a34fe88bbaa None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:49.098232 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a322-58ed-4dff-a7c7-5a34fe88bbaa None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:49.100815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 519/1018] 10.222.0.47 () {54 vars in 966 bytes} [Mon Jul 25 20:28:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:49.109846 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1091-0b76-49a8-9915-c593a3e592ad None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:49.110220 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1091-0b76-49a8-9915-c593a3e592ad None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:49.110587 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1091-0b76-49a8-9915-c593a3e592ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:49.186627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-53ea1091-0b76-49a8-9915-c593a3e592ad None None] MFA Rules not processed for user `5834a66b3514487db2d99bad0d086030`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:49.189346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-53ea1091-0b76-49a8-9915-c593a3e592ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:49.314678 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 500/1019] 10.222.0.47 () {58 vars in 1063 bytes} [Mon Jul 25 20:28:49 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:49.328291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a322-58ed-4dff-a7c7-5a34fe88bbaa None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:49.341724 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a322-58ed-4dff-a7c7-5a34fe88bbaa None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:49.345989 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ada2d-03cd-4e06-8392-71405dce2b15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5834a66b3514487db2d99bad0d086030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:49.346673 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ada2d-03cd-4e06-8392-71405dce2b15 service glance] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:49.346984 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ada2d-03cd-4e06-8392-71405dce2b15 service glance] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:49.347207 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ada2d-03cd-4e06-8392-71405dce2b15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:49.360269 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ada2d-03cd-4e06-8392-71405dce2b15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:49.361931 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ada2d-03cd-4e06-8392-71405dce2b15 service glance] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:49.379103 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 520/1020] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:49.568508 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dc13-5ecb-4d6b-9346-b88bd9a53687 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:49.568779 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dc13-5ecb-4d6b-9346-b88bd9a53687 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:49.568968 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dc13-5ecb-4d6b-9346-b88bd9a53687 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:49.570438 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 501/1021] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:49.577442 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a133-ac15-43a9-bcbc-434f1542b619 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:49.577808 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a133-ac15-43a9-bcbc-434f1542b619 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:49.578153 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7a133-ac15-43a9-bcbc-434f1542b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:49.602311 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-56f7a133-ac15-43a9-bcbc-434f1542b619 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:49.603871 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-56f7a133-ac15-43a9-bcbc-434f1542b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:49.614395 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 521/1022] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:28:49.679941 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368dc13-5ecb-4d6b-9346-b88bd9a53687 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:49.700490 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368dc13-5ecb-4d6b-9346-b88bd9a53687 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:49.710875 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de47fb-f159-4baf-b8af-cb18054dab33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:49.711950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de47fb-f159-4baf-b8af-cb18054dab33 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:49.712445 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de47fb-f159-4baf-b8af-cb18054dab33 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:49.713313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de47fb-f159-4baf-b8af-cb18054dab33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:49.731121 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de47fb-f159-4baf-b8af-cb18054dab33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:49.734329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de47fb-f159-4baf-b8af-cb18054dab33 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:49.755789 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 502/1023] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:28:53.477079 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2732493-b1e6-41a7-9974-cfbe27726b36 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:53.478116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2732493-b1e6-41a7-9974-cfbe27726b36 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:53.478116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2732493-b1e6-41a7-9974-cfbe27726b36 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:53.480815 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 522/1024] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:28:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:28:53.495032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d9abb-6b73-4bc5-969b-f0688b20c59a None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:53.495032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d9abb-6b73-4bc5-969b-f0688b20c59a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:53.495032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d9abb-6b73-4bc5-969b-f0688b20c59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:53.514316 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-8e4d9abb-6b73-4bc5-969b-f0688b20c59a None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:28:53.515737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-8e4d9abb-6b73-4bc5-969b-f0688b20c59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:28:53.525085 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 503/1025] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:28:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:28:53.585894 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2732493-b1e6-41a7-9974-cfbe27726b36 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:28:53.613351 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2732493-b1e6-41a7-9974-cfbe27726b36 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:28:53.622482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656525a-2a61-4f3c-8da1-eb69456cab3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:28:53.624114 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656525a-2a61-4f3c-8da1-eb69456cab3c service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:28:53.624621 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656525a-2a61-4f3c-8da1-eb69456cab3c service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:28:53.625162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656525a-2a61-4f3c-8da1-eb69456cab3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:28:53.642652 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656525a-2a61-4f3c-8da1-eb69456cab3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:28:53.645905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656525a-2a61-4f3c-8da1-eb69456cab3c service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:28:53.668377 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 523/1026] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:28:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:03.509535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=55 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:03.660698 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=82 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:08.565898 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf74e-7129-4876-a71c-428a50bcd605 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:08.566850 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf74e-7129-4876-a71c-428a50bcd605 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:08.566850 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf74e-7129-4876-a71c-428a50bcd605 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:08.567782 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 504/1027] 10.222.0.47 () {54 vars in 918 bytes} [Mon Jul 25 20:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:08.574351 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e38c-0b30-42da-983d-28a21057c340 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:08.575021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e38c-0b30-42da-983d-28a21057c340 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:08.575021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e38c-0b30-42da-983d-28a21057c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:08.600430 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-4263e38c-0b30-42da-983d-28a21057c340 None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:08.601731 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4263e38c-0b30-42da-983d-28a21057c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:08.616349 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 524/1028] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Jul 25 20:29:08 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:29:08.634287 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2980-470a-4c3a-a291-a78ec1d7096f None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:08.634753 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2980-470a-4c3a-a291-a78ec1d7096f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:08.635226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2980-470a-4c3a-a291-a78ec1d7096f None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:08.637873 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 505/1029] 10.222.0.47 () {54 vars in 918 bytes} [Mon Jul 25 20:29:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:08.646710 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad4205-c701-4230-b420-80834bb6b275 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:08.647166 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad4205-c701-4230-b420-80834bb6b275 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:08.647343 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad4205-c701-4230-b420-80834bb6b275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:08.678860 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-afad4205-c701-4230-b420-80834bb6b275 None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:08.680522 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-afad4205-c701-4230-b420-80834bb6b275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:08.696209 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 525/1030] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Jul 25 20:29:08 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:29:12.581385 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3d62-d60a-4d65-8050-b549916c5149 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:12.582299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3d62-d60a-4d65-8050-b549916c5149 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:12.582299 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3d62-d60a-4d65-8050-b549916c5149 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:12.583656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 506/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:12.590976 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5881-7ca0-4dfb-98dc-e962838c57a5 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:12.592106 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5881-7ca0-4dfb-98dc-e962838c57a5 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:12.592106 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5881-7ca0-4dfb-98dc-e962838c57a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:12.620500 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-307e5881-7ca0-4dfb-98dc-e962838c57a5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:12.621942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-307e5881-7ca0-4dfb-98dc-e962838c57a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:12.634123 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 526/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:29:12.698576 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3d62-d60a-4d65-8050-b549916c5149 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:12.718161 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3d62-d60a-4d65-8050-b549916c5149 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:12.726636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd09d3-ff53-402d-aa1b-1f6e8c4c3964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:12.727439 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd09d3-ff53-402d-aa1b-1f6e8c4c3964 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:12.727823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd09d3-ff53-402d-aa1b-1f6e8c4c3964 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:12.728204 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd09d3-ff53-402d-aa1b-1f6e8c4c3964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:12.740817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd09d3-ff53-402d-aa1b-1f6e8c4c3964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:12.743776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd09d3-ff53-402d-aa1b-1f6e8c4c3964 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:12.757856 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 507/1033] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:13.939364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6847d-6062-4ab1-a7c6-cfcb475f4eff None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:13.939975 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6847d-6062-4ab1-a7c6-cfcb475f4eff None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:13.939975 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6847d-6062-4ab1-a7c6-cfcb475f4eff None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:13.941672 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 527/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:13.947754 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64463f-2186-4d63-85f6-b9057bf2f68c None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:13.948368 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64463f-2186-4d63-85f6-b9057bf2f68c None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:13.948368 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64463f-2186-4d63-85f6-b9057bf2f68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:13.970965 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-dd64463f-2186-4d63-85f6-b9057bf2f68c None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:13.972233 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-dd64463f-2186-4d63-85f6-b9057bf2f68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:13.980674 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 508/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:29:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:14.232499 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6847d-6062-4ab1-a7c6-cfcb475f4eff None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:14.248534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6847d-6062-4ab1-a7c6-cfcb475f4eff None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:14.254626 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c4d32-7735-43b0-87a8-cc8092ea3fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:14.255365 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c4d32-7735-43b0-87a8-cc8092ea3fc6 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:14.255692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c4d32-7735-43b0-87a8-cc8092ea3fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:14.255928 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c4d32-7735-43b0-87a8-cc8092ea3fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:14.266938 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c4d32-7735-43b0-87a8-cc8092ea3fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:14.268577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c4d32-7735-43b0-87a8-cc8092ea3fc6 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:14.280046 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 528/1036] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:15.385610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116781f6-4df9-411a-b96d-8ce2a55299fb None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:15.386186 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116781f6-4df9-411a-b96d-8ce2a55299fb None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:15.386186 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116781f6-4df9-411a-b96d-8ce2a55299fb None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:15.387623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 509/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:15.395549 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76371f8f-0e29-4ab3-8049-93e3d312fa93 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:15.396718 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76371f8f-0e29-4ab3-8049-93e3d312fa93 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:15.397075 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76371f8f-0e29-4ab3-8049-93e3d312fa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:15.419638 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-76371f8f-0e29-4ab3-8049-93e3d312fa93 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:15.420916 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-76371f8f-0e29-4ab3-8049-93e3d312fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:15.430338 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 529/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:29:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:15.597744 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116781f6-4df9-411a-b96d-8ce2a55299fb None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:15.613561 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116781f6-4df9-411a-b96d-8ce2a55299fb None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:15.619195 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6c53-8b74-40a6-9322-ef297ba51f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:15.619838 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6c53-8b74-40a6-9322-ef297ba51f99 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:15.620119 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6c53-8b74-40a6-9322-ef297ba51f99 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:15.620393 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6c53-8b74-40a6-9322-ef297ba51f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:15.630801 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c6c53-8b74-40a6-9322-ef297ba51f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:15.632565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c6c53-8b74-40a6-9322-ef297ba51f99 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:15.645068 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 510/1039] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:16.655380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04a89-e4dc-482a-a8a3-5efd482133be None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:16.656256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04a89-e4dc-482a-a8a3-5efd482133be None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:16.656534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f04a89-e4dc-482a-a8a3-5efd482133be None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:16.658946 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 530/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:29:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:16.664879 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd48c-724f-4634-91e8-fbc84e2e9de3 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:16.665774 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd48c-724f-4634-91e8-fbc84e2e9de3 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:16.665774 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd48c-724f-4634-91e8-fbc84e2e9de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:16.689452 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-c21dd48c-724f-4634-91e8-fbc84e2e9de3 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:16.690713 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-c21dd48c-724f-4634-91e8-fbc84e2e9de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:16.699715 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 511/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:29:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:16.931364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f04a89-e4dc-482a-a8a3-5efd482133be None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:16.956007 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f04a89-e4dc-482a-a8a3-5efd482133be None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:16.964739 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e1039-f620-4246-ae02-9b58b8828b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:16.965877 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e1039-f620-4246-ae02-9b58b8828b72 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:16.966384 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e1039-f620-4246-ae02-9b58b8828b72 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:16.967430 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e1039-f620-4246-ae02-9b58b8828b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:16.978895 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e1039-f620-4246-ae02-9b58b8828b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:16.980662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e1039-f620-4246-ae02-9b58b8828b72 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:16.993012 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 531/1042] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:17.991313 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b656-4a13-4dab-be7e-bceb95d895ab None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:17.992077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b656-4a13-4dab-be7e-bceb95d895ab None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:17.992077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b656-4a13-4dab-be7e-bceb95d895ab None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:17.993508 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 512/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:18.000305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da891c-9176-468c-83d3-f8b220d39023 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:18.001029 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da891c-9176-468c-83d3-f8b220d39023 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:18.001029 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da891c-9176-468c-83d3-f8b220d39023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:18.024245 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-d2da891c-9176-468c-83d3-f8b220d39023 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:18.025556 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-d2da891c-9176-468c-83d3-f8b220d39023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:18.041188 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 532/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:29:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:18.206756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b656-4a13-4dab-be7e-bceb95d895ab None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:18.223352 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b656-4a13-4dab-be7e-bceb95d895ab None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:18.229884 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff4f5-ac4a-486b-be8e-6df9f0789fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:18.230548 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff4f5-ac4a-486b-be8e-6df9f0789fcc service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:18.230824 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff4f5-ac4a-486b-be8e-6df9f0789fcc service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:18.231099 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff4f5-ac4a-486b-be8e-6df9f0789fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:18.242758 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff4f5-ac4a-486b-be8e-6df9f0789fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:18.244309 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff4f5-ac4a-486b-be8e-6df9f0789fcc service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:18.258867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 513/1045] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:19.194286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b25d5-77ac-4866-a8a3-a7ac55444087 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:19.195073 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b25d5-77ac-4866-a8a3-a7ac55444087 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:19.195073 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b25d5-77ac-4866-a8a3-a7ac55444087 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:19.196314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 533/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:19.202228 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd377fa-bd3a-4531-a071-905932f46744 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:19.204142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd377fa-bd3a-4531-a071-905932f46744 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:19.204142 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd377fa-bd3a-4531-a071-905932f46744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:19.227983 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-1fd377fa-bd3a-4531-a071-905932f46744 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:19.230317 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-1fd377fa-bd3a-4531-a071-905932f46744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:19.244162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 514/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:29:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:29:19.524115 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b25d5-77ac-4866-a8a3-a7ac55444087 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:19.540028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b25d5-77ac-4866-a8a3-a7ac55444087 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:19.545626 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7bf76-7f36-46d5-94c9-72e6f56d0e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:19.546882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7bf76-7f36-46d5-94c9-72e6f56d0e9f service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:19.547162 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7bf76-7f36-46d5-94c9-72e6f56d0e9f service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:19.547433 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7bf76-7f36-46d5-94c9-72e6f56d0e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:19.559290 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7bf76-7f36-46d5-94c9-72e6f56d0e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:19.560936 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7bf76-7f36-46d5-94c9-72e6f56d0e9f service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:19.572747 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 534/1048] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:20.466401 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164a5ab-1994-4280-91e3-c0594f4ba0be None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:20.466960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164a5ab-1994-4280-91e3-c0594f4ba0be None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:20.467264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164a5ab-1994-4280-91e3-c0594f4ba0be None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:20.470546 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 515/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:29:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:20.476877 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7361c-7812-4515-bd73-748271f5fdf1 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:20.477542 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7361c-7812-4515-bd73-748271f5fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:20.477542 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7361c-7812-4515-bd73-748271f5fdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:20.501333 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-35a7361c-7812-4515-bd73-748271f5fdf1 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:20.502844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-35a7361c-7812-4515-bd73-748271f5fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:20.511524 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 535/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:29:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:20.682421 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164a5ab-1994-4280-91e3-c0594f4ba0be None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:20.698276 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164a5ab-1994-4280-91e3-c0594f4ba0be None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:20.704427 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac0d67-50c6-4410-b17b-ad3bca2558e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:20.705077 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0d67-50c6-4410-b17b-ad3bca2558e8 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:20.705394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0d67-50c6-4410-b17b-ad3bca2558e8 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:20.705681 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0d67-50c6-4410-b17b-ad3bca2558e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:20.722033 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac0d67-50c6-4410-b17b-ad3bca2558e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:20.725095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac0d67-50c6-4410-b17b-ad3bca2558e8 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:20.740391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 516/1051] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:21.684631 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527528-1048-4943-988f-021fe0faf9c1 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:21.685319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527528-1048-4943-988f-021fe0faf9c1 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:21.685319 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527528-1048-4943-988f-021fe0faf9c1 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:21.686855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 536/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:21.693020 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a825cf8-aad4-4164-ae1c-2fd916d6401c None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:21.693653 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a825cf8-aad4-4164-ae1c-2fd916d6401c None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:21.693782 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a825cf8-aad4-4164-ae1c-2fd916d6401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:21.716891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-6a825cf8-aad4-4164-ae1c-2fd916d6401c None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:21.718852 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-6a825cf8-aad4-4164-ae1c-2fd916d6401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:21.728090 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 517/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:29:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:21.891159 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f527528-1048-4943-988f-021fe0faf9c1 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:21.905309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f527528-1048-4943-988f-021fe0faf9c1 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:21.911391 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440fa4a-013b-463f-b14a-2d1eaf03ba2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:21.912031 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440fa4a-013b-463f-b14a-2d1eaf03ba2a service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:21.912303 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440fa4a-013b-463f-b14a-2d1eaf03ba2a service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:21.912576 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440fa4a-013b-463f-b14a-2d1eaf03ba2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:21.923279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440fa4a-013b-463f-b14a-2d1eaf03ba2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:21.925230 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440fa4a-013b-463f-b14a-2d1eaf03ba2a service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:21.936389 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 537/1054] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:22.921681 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf116-6575-4504-81b7-00cdabf2f8c6 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:22.922549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf116-6575-4504-81b7-00cdabf2f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:22.922745 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf116-6575-4504-81b7-00cdabf2f8c6 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:22.924324 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 518/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:29:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:22.930798 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadb1ff-ac01-4286-991d-f2592bee049a None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:22.931474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadb1ff-ac01-4286-991d-f2592bee049a None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:22.931474 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadb1ff-ac01-4286-991d-f2592bee049a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:22.956364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-4eadb1ff-ac01-4286-991d-f2592bee049a None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:22.957666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4eadb1ff-ac01-4286-991d-f2592bee049a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:22.968410 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 538/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:29:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:29:23.266088 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcf116-6575-4504-81b7-00cdabf2f8c6 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:23.282095 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcf116-6575-4504-81b7-00cdabf2f8c6 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:23.287709 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086e74-f901-47be-8d55-03e271e30a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:23.288358 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086e74-f901-47be-8d55-03e271e30a8e service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:23.288638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086e74-f901-47be-8d55-03e271e30a8e service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:23.288899 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086e74-f901-47be-8d55-03e271e30a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:23.301155 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086e74-f901-47be-8d55-03e271e30a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:23.302807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086e74-f901-47be-8d55-03e271e30a8e service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:23.314792 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 519/1057] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:25.850584 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953920-31b9-453c-8642-d12f0c947c12 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:25.851229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953920-31b9-453c-8642-d12f0c947c12 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:25.851229 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953920-31b9-453c-8642-d12f0c947c12 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:25.852654 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 539/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:25.859994 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102816-b0a5-4275-abdd-4ce9a4926b06 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:25.860584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102816-b0a5-4275-abdd-4ce9a4926b06 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:25.860584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96102816-b0a5-4275-abdd-4ce9a4926b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:25.883476 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-96102816-b0a5-4275-abdd-4ce9a4926b06 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:25.884790 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-96102816-b0a5-4275-abdd-4ce9a4926b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:25.894467 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 520/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:25.962357 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f953920-31b9-453c-8642-d12f0c947c12 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:25.976922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f953920-31b9-453c-8642-d12f0c947c12 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:25.981536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1126ff0-65dd-4622-aea8-26b139a550e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:25.981536 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1126ff0-65dd-4622-aea8-26b139a550e0 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:25.981925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1126ff0-65dd-4622-aea8-26b139a550e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:25.982176 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1126ff0-65dd-4622-aea8-26b139a550e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:25.994055 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1126ff0-65dd-4622-aea8-26b139a550e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:25.995549 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1126ff0-65dd-4622-aea8-26b139a550e0 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:26.007206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 540/1060] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:28.971891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb472-38cd-4913-88a4-8a7cf71d96ef None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:28.972658 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb472-38cd-4913-88a4-8a7cf71d96ef None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:28.972658 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb472-38cd-4913-88a4-8a7cf71d96ef None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:28.973931 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 521/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:29:28.981330 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee56c3-35b7-4583-bd41-87508849ad24 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:28.982005 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee56c3-35b7-4583-bd41-87508849ad24 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:28.982279 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee56c3-35b7-4583-bd41-87508849ad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:29.009938 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-2aee56c3-35b7-4583-bd41-87508849ad24 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:29.011127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-2aee56c3-35b7-4583-bd41-87508849ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:29.020391 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 541/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:29.063282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fb472-38cd-4913-88a4-8a7cf71d96ef None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:29.080779 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fb472-38cd-4913-88a4-8a7cf71d96ef None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:29.085775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7fc6e-014d-43a6-be6c-2f3608213094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:29.086423 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fc6e-014d-43a6-be6c-2f3608213094 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:29.086709 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fc6e-014d-43a6-be6c-2f3608213094 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:29.086991 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fc6e-014d-43a6-be6c-2f3608213094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:29.098930 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7fc6e-014d-43a6-be6c-2f3608213094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:29.100520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7fc6e-014d-43a6-be6c-2f3608213094 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:29.114180 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 522/1063] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:32.055317 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79d0a-f689-45c4-9aef-0e643f449a5f None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:32.056309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79d0a-f689-45c4-9aef-0e643f449a5f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:32.056309 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79d0a-f689-45c4-9aef-0e643f449a5f None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:32.057384 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 542/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:32.066024 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c36a-343a-427a-962b-09da2f6fef6f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:32.066530 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c36a-343a-427a-962b-09da2f6fef6f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:32.067015 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256c36a-343a-427a-962b-09da2f6fef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:32.099878 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-7256c36a-343a-427a-962b-09da2f6fef6f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:32.101276 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-7256c36a-343a-427a-962b-09da2f6fef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:32.110891 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 523/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:32.154264 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79d0a-f689-45c4-9aef-0e643f449a5f None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:32.167541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79d0a-f689-45c4-9aef-0e643f449a5f None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:32.173399 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9ed01-93fc-4b89-adbe-755f18629e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:32.174035 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ed01-93fc-4b89-adbe-755f18629e58 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:32.174574 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ed01-93fc-4b89-adbe-755f18629e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:32.174846 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ed01-93fc-4b89-adbe-755f18629e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:32.185266 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9ed01-93fc-4b89-adbe-755f18629e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:32.188116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9ed01-93fc-4b89-adbe-755f18629e58 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:32.199251 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 543/1066] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:35.002179 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943fe8c-301c-4f74-b98f-7e6729e661cc None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:35.002757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943fe8c-301c-4f74-b98f-7e6729e661cc None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:35.002936 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943fe8c-301c-4f74-b98f-7e6729e661cc None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:35.004450 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 524/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:35.011323 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abd5a-320d-4f0d-a15f-478437bab7c5 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:35.011950 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abd5a-320d-4f0d-a15f-478437bab7c5 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:35.011950 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abd5a-320d-4f0d-a15f-478437bab7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:35.020060 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=61 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:35.037769 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-657abd5a-320d-4f0d-a15f-478437bab7c5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:35.039605 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-657abd5a-320d-4f0d-a15f-478437bab7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:35.052580 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 544/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:35.102435 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943fe8c-301c-4f74-b98f-7e6729e661cc None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:35.109249 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=55 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:35.117795 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943fe8c-301c-4f74-b98f-7e6729e661cc None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:35.122319 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42effac5-56df-4468-9999-f22e94c80d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:35.123104 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42effac5-56df-4468-9999-f22e94c80d7f service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:35.124447 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42effac5-56df-4468-9999-f22e94c80d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:35.124639 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42effac5-56df-4468-9999-f22e94c80d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:35.136329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42effac5-56df-4468-9999-f22e94c80d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:35.137880 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42effac5-56df-4468-9999-f22e94c80d7f service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:35.152746 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 525/1069] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:38.444504 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbc29-2983-44b4-b569-14226f26044d None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:38.445038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbc29-2983-44b4-b569-14226f26044d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:38.445038 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bbc29-2983-44b4-b569-14226f26044d None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:38.446613 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 545/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:38.453168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026b77-9d14-49a8-9697-937ad3bc6e28 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:38.454029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026b77-9d14-49a8-9697-937ad3bc6e28 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:38.454029 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026b77-9d14-49a8-9697-937ad3bc6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:38.476329 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-fd026b77-9d14-49a8-9697-937ad3bc6e28 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:38.477658 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-fd026b77-9d14-49a8-9697-937ad3bc6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:38.487040 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 526/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:29:38.533440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bbc29-2983-44b4-b569-14226f26044d None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:38.546614 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bbc29-2983-44b4-b569-14226f26044d None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:38.551185 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef56fe0-207d-4d3f-b9e6-560d778fd0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:38.551827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef56fe0-207d-4d3f-b9e6-560d778fd0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:38.552108 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef56fe0-207d-4d3f-b9e6-560d778fd0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:38.552380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef56fe0-207d-4d3f-b9e6-560d778fd0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:38.564500 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef56fe0-207d-4d3f-b9e6-560d778fd0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:38.566722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef56fe0-207d-4d3f-b9e6-560d778fd0a2 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:38.580271 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 546/1072] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:41.103869 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87371-a24d-4b70-bcc6-b50bc04ce84e None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:41.104807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87371-a24d-4b70-bcc6-b50bc04ce84e None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:41.104989 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87371-a24d-4b70-bcc6-b50bc04ce84e None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:41.106915 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 527/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:29:41.114200 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ddd7-fcc8-42f3-9fc3-5d40469ac1fe None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:41.114904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ddd7-fcc8-42f3-9fc3-5d40469ac1fe None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:41.114904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ddd7-fcc8-42f3-9fc3-5d40469ac1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:41.137210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ed57ddd7-fcc8-42f3-9fc3-5d40469ac1fe None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:41.138488 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ed57ddd7-fcc8-42f3-9fc3-5d40469ac1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:41.148027 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 547/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:41.190394 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f87371-a24d-4b70-bcc6-b50bc04ce84e None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:41.206733 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f87371-a24d-4b70-bcc6-b50bc04ce84e None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:41.210752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056ec02-659c-4fe3-9c30-8c991da45519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:41.211520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056ec02-659c-4fe3-9c30-8c991da45519 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:41.211837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056ec02-659c-4fe3-9c30-8c991da45519 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:41.212215 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056ec02-659c-4fe3-9c30-8c991da45519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:41.224909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056ec02-659c-4fe3-9c30-8c991da45519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:41.227165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056ec02-659c-4fe3-9c30-8c991da45519 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:41.241248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 528/1075] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:44.013705 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574560b-6e34-463a-b935-9a818392128c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:44.014607 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574560b-6e34-463a-b935-9a818392128c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:44.014607 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574560b-6e34-463a-b935-9a818392128c None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:44.015827 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 548/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:29:44.026124 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd672-92d3-47fa-b756-b6e6da6fb5ef None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:44.026756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd672-92d3-47fa-b756-b6e6da6fb5ef None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:44.026756 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fd672-92d3-47fa-b756-b6e6da6fb5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:44.085718 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-ef3fd672-92d3-47fa-b756-b6e6da6fb5ef None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:44.087799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ef3fd672-92d3-47fa-b756-b6e6da6fb5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:44.175948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 529/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:44.225937 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574560b-6e34-463a-b935-9a818392128c None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:44.237703 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574560b-6e34-463a-b935-9a818392128c None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:44.241507 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff019b-8387-4a97-98cf-30bdf6ef2dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:44.242134 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff019b-8387-4a97-98cf-30bdf6ef2dca service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:44.242412 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff019b-8387-4a97-98cf-30bdf6ef2dca service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:44.242686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff019b-8387-4a97-98cf-30bdf6ef2dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:44.253942 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff019b-8387-4a97-98cf-30bdf6ef2dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:44.255451 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff019b-8387-4a97-98cf-30bdf6ef2dca service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:44.267334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 549/1078] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:46.787828 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673dbb8-882d-47ad-903d-5449d1039803 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:46.788736 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673dbb8-882d-47ad-903d-5449d1039803 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:46.788736 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673dbb8-882d-47ad-903d-5449d1039803 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:46.790481 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 530/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:46.796138 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbcfec-4407-48e8-b480-d1c6efe1f437 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:46.796749 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbcfec-4407-48e8-b480-d1c6efe1f437 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:46.796749 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbcfec-4407-48e8-b480-d1c6efe1f437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:46.865522 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-33fbcfec-4407-48e8-b480-d1c6efe1f437 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:46.866821 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-33fbcfec-4407-48e8-b480-d1c6efe1f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:46.883866 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 550/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:46.949453 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673dbb8-882d-47ad-903d-5449d1039803 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:46.962548 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673dbb8-882d-47ad-903d-5449d1039803 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:46.966515 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890f720-bfbe-4003-bf22-dc8b724fcd1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:46.967208 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f720-bfbe-4003-bf22-dc8b724fcd1a service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:46.967493 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f720-bfbe-4003-bf22-dc8b724fcd1a service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:46.967772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f720-bfbe-4003-bf22-dc8b724fcd1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:46.980718 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890f720-bfbe-4003-bf22-dc8b724fcd1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:46.983314 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890f720-bfbe-4003-bf22-dc8b724fcd1a service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:46.995231 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 531/1081] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:29:49.766920 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e83180-1870-469f-b6b5-1275b0728bd2 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:49.767578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e83180-1870-469f-b6b5-1275b0728bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:49.767578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e83180-1870-469f-b6b5-1275b0728bd2 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:49.769097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 551/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:49.777335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058242a2-db48-4ad1-b31f-a9a3ddee3937 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:49.778212 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058242a2-db48-4ad1-b31f-a9a3ddee3937 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:49.778212 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058242a2-db48-4ad1-b31f-a9a3ddee3937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:49.803309 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-058242a2-db48-4ad1-b31f-a9a3ddee3937 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:49.805480 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-058242a2-db48-4ad1-b31f-a9a3ddee3937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:49.820215 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 532/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:49.861183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e83180-1870-469f-b6b5-1275b0728bd2 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:49.873680 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e83180-1870-469f-b6b5-1275b0728bd2 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:49.881308 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1a832-c6cd-4347-8fee-366aec28392b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:49.881949 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a832-c6cd-4347-8fee-366aec28392b service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:49.882230 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a832-c6cd-4347-8fee-366aec28392b service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:49.882509 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1a832-c6cd-4347-8fee-366aec28392b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:49.895557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1a832-c6cd-4347-8fee-366aec28392b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:49.897274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1a832-c6cd-4347-8fee-366aec28392b service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:49.909249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 552/1084] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:29:52.464584 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1898-b768-4b32-9ee4-8a6f05d961fa None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:52.465364 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1898-b768-4b32-9ee4-8a6f05d961fa None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:52.465364 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed1898-b768-4b32-9ee4-8a6f05d961fa None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:52.466570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 533/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:29:52.472819 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81e3e-7a40-41ff-9fc9-80f05745bad1 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:52.473638 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81e3e-7a40-41ff-9fc9-80f05745bad1 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:52.473638 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81e3e-7a40-41ff-9fc9-80f05745bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:52.498789 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-66c81e3e-7a40-41ff-9fc9-80f05745bad1 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:29:52.500534 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-66c81e3e-7a40-41ff-9fc9-80f05745bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:29:52.511702 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 553/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:29:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:29:52.554186 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed1898-b768-4b32-9ee4-8a6f05d961fa None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:29:52.574585 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed1898-b768-4b32-9ee4-8a6f05d961fa None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:29:52.579547 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ec60e-c21f-4a8c-8eb1-1fe3914371d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:29:52.580194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec60e-c21f-4a8c-8eb1-1fe3914371d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:29:52.580530 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec60e-c21f-4a8c-8eb1-1fe3914371d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:29:52.580807 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec60e-c21f-4a8c-8eb1-1fe3914371d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:29:52.592835 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ec60e-c21f-4a8c-8eb1-1fe3914371d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:29:52.594344 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ec60e-c21f-4a8c-8eb1-1fe3914371d3 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:29:52.608572 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 534/1087] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:29:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:30:02.491108 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=42 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:02.602757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=53 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:20.670701 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36b30-d856-4829-91ad-c10caaa3bd48 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:20.671674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36b30-d856-4829-91ad-c10caaa3bd48 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:20.671674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d36b30-d856-4829-91ad-c10caaa3bd48 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:20.672982 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 554/1088] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:30:20.679390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4dbe5-5ab5-47bd-98d8-ee81bda475d6 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:20.680078 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4dbe5-5ab5-47bd-98d8-ee81bda475d6 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:20.680078 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4dbe5-5ab5-47bd-98d8-ee81bda475d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:20.705458 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-9da4dbe5-5ab5-47bd-98d8-ee81bda475d6 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:30:20.706874 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-9da4dbe5-5ab5-47bd-98d8-ee81bda475d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:30:20.716711 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 535/1089] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:30:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:30:20.793756 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b535d7b-2ee7-4727-96e8-263c0cf2b2ed None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:20.794034 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b535d7b-2ee7-4727-96e8-263c0cf2b2ed None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:20.794573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b535d7b-2ee7-4727-96e8-263c0cf2b2ed None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:20.797444 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 555/1090] 10.222.0.47 () {54 vars in 966 bytes} [Mon Jul 25 20:30:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:30:20.806950 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629007-d3b3-48c2-9ebb-74880e99f8a0 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:20.808451 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629007-d3b3-48c2-9ebb-74880e99f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:20.808451 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629007-d3b3-48c2-9ebb-74880e99f8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:20.866473 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-f0629007-d3b3-48c2-9ebb-74880e99f8a0 None None] MFA Rules not processed for user `5834a66b3514487db2d99bad0d086030`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:30:20.868787 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-f0629007-d3b3-48c2-9ebb-74880e99f8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:30:20.906252 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 536/1091] 10.222.0.47 () {58 vars in 1063 bytes} [Mon Jul 25 20:30:20 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:30:20.928025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b535d7b-2ee7-4727-96e8-263c0cf2b2ed None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:30:20.943668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b535d7b-2ee7-4727-96e8-263c0cf2b2ed None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:30:20.950573 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd266b8-808e-4d5b-bdbb-b10752f54576 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5834a66b3514487db2d99bad0d086030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:30:20.951649 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd266b8-808e-4d5b-bdbb-b10752f54576 service glance] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:20.952138 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd266b8-808e-4d5b-bdbb-b10752f54576 service glance] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:20.952634 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd266b8-808e-4d5b-bdbb-b10752f54576 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:20.970013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd266b8-808e-4d5b-bdbb-b10752f54576 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:30:20.971663 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd266b8-808e-4d5b-bdbb-b10752f54576 service glance] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:30:20.991323 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 556/1092] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:30:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:30:24.654377 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf4ff-4f06-4977-8354-a1e54dade4f6 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:24.654981 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf4ff-4f06-4977-8354-a1e54dade4f6 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:24.655362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf4ff-4f06-4977-8354-a1e54dade4f6 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:24.657926 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 537/1093] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:30:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:30:24.666644 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3d6c-8707-4534-bd56-3c52f47a395f None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:24.667426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3d6c-8707-4534-bd56-3c52f47a395f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:24.667426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3d6c-8707-4534-bd56-3c52f47a395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:24.690070 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-66af3d6c-8707-4534-bd56-3c52f47a395f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:30:24.691716 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-66af3d6c-8707-4534-bd56-3c52f47a395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:30:24.702021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 557/1094] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:30:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:30:24.731833 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf4ff-4f06-4977-8354-a1e54dade4f6 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:30:24.747776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf4ff-4f06-4977-8354-a1e54dade4f6 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:30:24.753778 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222335c9-92b0-4f83-834f-1f41bd523183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:30:24.754468 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222335c9-92b0-4f83-834f-1f41bd523183 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:24.754789 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222335c9-92b0-4f83-834f-1f41bd523183 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:24.755107 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222335c9-92b0-4f83-834f-1f41bd523183 admin admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:24.756045 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222335c9-92b0-4f83-834f-1f41bd523183 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:30:24.758424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING py.warnings [None req-222335c9-92b0-4f83-834f-1f41bd523183 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:30:24.758424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: warnings.warn(msg) Jul 25 20:30:24.758424 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: Jul 25 20:30:24.760808 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222335c9-92b0-4f83-834f-1f41bd523183 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:30:24.784830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 538/1095] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 20:30:24 2022] GET /identity/v3/projects => generated 1606 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 20:30:27.570958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2a60-b96f-4813-a4bc-ce3b0e0aff50 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:27.571565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2a60-b96f-4813-a4bc-ce3b0e0aff50 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:27.571565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2a60-b96f-4813-a4bc-ce3b0e0aff50 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:27.572958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 558/1096] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:30:27.581072 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b33c2-bcac-4aa8-a045-9c57da911acf None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:27.581874 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b33c2-bcac-4aa8-a045-9c57da911acf None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:27.582208 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b33c2-bcac-4aa8-a045-9c57da911acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:27.618341 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-374b33c2-bcac-4aa8-a045-9c57da911acf None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:30:27.620492 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-374b33c2-bcac-4aa8-a045-9c57da911acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:30:27.635497 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 539/1097] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:30:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:30:27.693193 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec2a60-b96f-4813-a4bc-ce3b0e0aff50 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:30:27.726868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec2a60-b96f-4813-a4bc-ce3b0e0aff50 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:30:27.736090 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dde948-2b7c-4b8b-b2b2-79d2ca06b497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:30:27.737030 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde948-2b7c-4b8b-b2b2-79d2ca06b497 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:27.737523 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde948-2b7c-4b8b-b2b2-79d2ca06b497 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:27.737993 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde948-2b7c-4b8b-b2b2-79d2ca06b497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:27.757366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dde948-2b7c-4b8b-b2b2-79d2ca06b497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:30:27.760641 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dde948-2b7c-4b8b-b2b2-79d2ca06b497 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:30:27.788608 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 559/1098] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:30:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:30:30.944960 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a9d8-6182-4787-8735-c5777db9e8b2 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:30.945752 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a9d8-6182-4787-8735-c5777db9e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:30.946155 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a9d8-6182-4787-8735-c5777db9e8b2 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:30.948783 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 540/1099] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:30:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:30:30.955555 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf2632-bd13-466b-b02d-3ed8d408733e None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:30.956249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf2632-bd13-466b-b02d-3ed8d408733e None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:30.956249 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf2632-bd13-466b-b02d-3ed8d408733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:30.979788 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-4acf2632-bd13-466b-b02d-3ed8d408733e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:30:30.982358 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4acf2632-bd13-466b-b02d-3ed8d408733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:30:30.991219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 560/1100] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:30:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:30:31.040827 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a9d8-6182-4787-8735-c5777db9e8b2 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:30:31.054793 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a9d8-6182-4787-8735-c5777db9e8b2 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:30:31.058900 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2538-5086-4e7e-888f-c2aa90db1a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:30:31.059808 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2538-5086-4e7e-888f-c2aa90db1a4b service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:31.060015 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2538-5086-4e7e-888f-c2aa90db1a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:31.061236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2538-5086-4e7e-888f-c2aa90db1a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:31.072188 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2538-5086-4e7e-888f-c2aa90db1a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:30:31.073731 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2538-5086-4e7e-888f-c2aa90db1a4b service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:30:31.085152 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 541/1101] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:30:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:30:33.719973 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ba8a5-b3cb-4e09-9cf9-842fbba509d3 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:33.720843 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ba8a5-b3cb-4e09-9cf9-842fbba509d3 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:33.720843 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ba8a5-b3cb-4e09-9cf9-842fbba509d3 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:33.723361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 561/1102] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:30:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:30:33.732428 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059707ae-8416-4beb-b91f-aa9caa0f49b5 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:33.733063 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059707ae-8416-4beb-b91f-aa9caa0f49b5 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:33.733392 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059707ae-8416-4beb-b91f-aa9caa0f49b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:33.761212 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-059707ae-8416-4beb-b91f-aa9caa0f49b5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:30:33.763463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-059707ae-8416-4beb-b91f-aa9caa0f49b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:30:33.776764 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 542/1103] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:30:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:30:33.823048 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ba8a5-b3cb-4e09-9cf9-842fbba509d3 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:30:33.838366 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ba8a5-b3cb-4e09-9cf9-842fbba509d3 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:30:33.844559 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147dbaf-3661-4be9-a0f3-78400dcbb57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:30:33.845419 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147dbaf-3661-4be9-a0f3-78400dcbb57b service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:33.845752 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147dbaf-3661-4be9-a0f3-78400dcbb57b service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:33.846112 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147dbaf-3661-4be9-a0f3-78400dcbb57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:33.857842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147dbaf-3661-4be9-a0f3-78400dcbb57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:30:33.859412 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147dbaf-3661-4be9-a0f3-78400dcbb57b service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:30:33.870352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 562/1104] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:30:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:30:36.664998 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70222b4-0840-4b54-b4af-fe5acb31dbc8 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:36.665737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70222b4-0840-4b54-b4af-fe5acb31dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:36.665737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70222b4-0840-4b54-b4af-fe5acb31dbc8 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:36.667011 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 543/1105] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:30:36.675039 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb571311-11d1-44ad-885c-c78ef75b3f69 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:36.675655 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb571311-11d1-44ad-885c-c78ef75b3f69 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:36.675655 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb571311-11d1-44ad-885c-c78ef75b3f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:36.700296 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-fb571311-11d1-44ad-885c-c78ef75b3f69 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:30:36.701837 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-fb571311-11d1-44ad-885c-c78ef75b3f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:30:36.710434 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 563/1106] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:30:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:30:36.764154 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70222b4-0840-4b54-b4af-fe5acb31dbc8 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:30:36.776793 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70222b4-0840-4b54-b4af-fe5acb31dbc8 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:30:36.782541 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff09b44-67b6-492f-8805-fd2783b0ab90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:30:36.786514 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09b44-67b6-492f-8805-fd2783b0ab90 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:36.786514 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09b44-67b6-492f-8805-fd2783b0ab90 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:36.786514 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09b44-67b6-492f-8805-fd2783b0ab90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:36.797761 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff09b44-67b6-492f-8805-fd2783b0ab90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:30:36.799303 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff09b44-67b6-492f-8805-fd2783b0ab90 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:30:36.813250 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 544/1107] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:30:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:30:39.897473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e41a8-4a78-457a-8df2-281a62060af9 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:39.898167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e41a8-4a78-457a-8df2-281a62060af9 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:39.898387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e41a8-4a78-457a-8df2-281a62060af9 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:39.900885 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 564/1108] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 20:30:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:30:39.909860 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf148-9f37-49da-963d-d51c06da50ff None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:39.910636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf148-9f37-49da-963d-d51c06da50ff None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:39.910636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf148-9f37-49da-963d-d51c06da50ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:39.940836 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-e6acf148-9f37-49da-963d-d51c06da50ff None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:30:39.943229 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-e6acf148-9f37-49da-963d-d51c06da50ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:30:39.961420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 545/1109] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 20:30:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:30:40.037043 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e41a8-4a78-457a-8df2-281a62060af9 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:30:40.057717 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e41a8-4a78-457a-8df2-281a62060af9 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:30:40.067697 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b641efc-b080-479d-afce-c25701a9df8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:30:40.068676 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641efc-b080-479d-afce-c25701a9df8a service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:30:40.069181 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641efc-b080-479d-afce-c25701a9df8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:30:40.070043 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641efc-b080-479d-afce-c25701a9df8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:30:40.084484 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641efc-b080-479d-afce-c25701a9df8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:30:40.086312 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641efc-b080-479d-afce-c25701a9df8a service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:30:40.100202 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 565/1110] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:30:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:30:49.931067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=44 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:50.094062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=33 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:31.639455 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300ac5-b44f-4cdf-9764-683220f70162 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:31.640338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300ac5-b44f-4cdf-9764-683220f70162 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:31.640338 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300ac5-b44f-4cdf-9764-683220f70162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:31.664790 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-2e300ac5-b44f-4cdf-9764-683220f70162 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:32:31.666939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-2e300ac5-b44f-4cdf-9764-683220f70162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:32:31.680073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 546/1111] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:32:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:32:31.689225 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415546-6673-4b0f-9ce1-d1f20545f8fe None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:31.690133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415546-6673-4b0f-9ce1-d1f20545f8fe None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:31.690133 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415546-6673-4b0f-9ce1-d1f20545f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:31.713742 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ae415546-6673-4b0f-9ce1-d1f20545f8fe None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:32:31.715063 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ae415546-6673-4b0f-9ce1-d1f20545f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:32:31.723894 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 566/1112] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:32:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:32:31.729259 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300ac5-b44f-4cdf-9764-683220f70162 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:31.741051 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300ac5-b44f-4cdf-9764-683220f70162 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:31.746491 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:31.747255 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:31.747540 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:31.747819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:31.748559 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:32:31.748974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:31.749984 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING py.warnings [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:32:31.749984 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: warnings.warn(msg) Jul 25 20:32:31.749984 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: Jul 25 20:32:31.750955 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:31.766107 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 547/1113] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Jul 25 20:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:32:31.780178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415546-6673-4b0f-9ce1-d1f20545f8fe None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:31.797907 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415546-6673-4b0f-9ce1-d1f20545f8fe None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:31.806777 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:31.807844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:31.808336 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:31.808814 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:31.810111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:31.813513 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING py.warnings [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:32:31.813513 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: warnings.warn(msg) Jul 25 20:32:31.813513 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: Jul 25 20:32:31.815898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:31.884910 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 567/1114] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 20:32:31 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:32:31.890690 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:31.907823 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cf054-e4f6-4b41-a4dd-039f4878e8d1 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:32.001508 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:32.002167 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.002444 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.002723 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.003414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:32.004462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING py.warnings [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:32:32.004462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: warnings.warn(msg) Jul 25 20:32:32.004462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: Jul 25 20:32:32.005790 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:32.034225 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 548/1115] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:32:31 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:32:32.042254 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:32.069144 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce3898-32a6-4aa6-9f31-4f3d4fde1960 admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:32.077557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:32.078582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.079057 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.079513 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.080717 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:32.082623 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING py.warnings [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:32:32.082623 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: warnings.warn(msg) Jul 25 20:32:32.082623 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: Jul 25 20:32:32.084910 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:32.112478 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 568/1116] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:32:32.119767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:32.131839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17335-9628-4d01-8325-481305874cd0 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:32.137362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f998d13-cb59-4a23-982b-357c24c29a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:32.138134 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998d13-cb59-4a23-982b-357c24c29a81 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.138430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998d13-cb59-4a23-982b-357c24c29a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.138775 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998d13-cb59-4a23-982b-357c24c29a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.139691 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f998d13-cb59-4a23-982b-357c24c29a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:32.140943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING py.warnings [None req-6f998d13-cb59-4a23-982b-357c24c29a81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:32:32.140943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: warnings.warn(msg) Jul 25 20:32:32.140943 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: Jul 25 20:32:32.142028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f998d13-cb59-4a23-982b-357c24c29a81 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:32.159383 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 549/1117] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:32:32.164737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:32.179663 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f486e8a-3744-4c36-b350-dae774d279d4 admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:32.185298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b219802-0218-4f04-84a7-93cca7453fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:32.186021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219802-0218-4f04-84a7-93cca7453fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.186278 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219802-0218-4f04-84a7-93cca7453fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.186563 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219802-0218-4f04-84a7-93cca7453fd9 admin admin] PATH_INFO: `/v3/projects/a91c1463a4964e78a52c3ebc9fc40da3/users/ef463e00110b467bae8499ac46920ef2/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.207414 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219802-0218-4f04-84a7-93cca7453fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91c1463a4964e78a52c3ebc9fc40da3, user_id=ef463e00110b467bae8499ac46920ef2, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:32.209175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING py.warnings [None req-0b219802-0218-4f04-84a7-93cca7453fd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:32:32.209175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: warnings.warn(msg) Jul 25 20:32:32.209175 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: Jul 25 20:32:32.213161 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219802-0218-4f04-84a7-93cca7453fd9 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:32.233215 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 569/1118] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 20:32:32 2022] PUT /identity/v3/projects/a91c1463a4964e78a52c3ebc9fc40da3/users/ef463e00110b467bae8499ac46920ef2/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:32:32.248073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e092e7-890f-4c21-96d7-a9db93f49636 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.248579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e092e7-890f-4c21-96d7-a9db93f49636 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.249058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e092e7-890f-4c21-96d7-a9db93f49636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.303115 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-77e092e7-890f-4c21-96d7-a9db93f49636 None None] MFA Rules not processed for user `ef463e00110b467bae8499ac46920ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:32:32.305450 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-77e092e7-890f-4c21-96d7-a9db93f49636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:32:32.417419 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 550/1119] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:32:32 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:32:32.433028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628ae1-e248-4a0a-89fa-472461e1df1e None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.433396 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628ae1-e248-4a0a-89fa-472461e1df1e None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.433628 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2628ae1-e248-4a0a-89fa-472461e1df1e None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.435167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 570/1120] 10.222.0.47 () {54 vars in 964 bytes} [Mon Jul 25 20:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:32:32.441441 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50bde-2452-4c27-9b1b-5d5c4fcb39ac None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.441858 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50bde-2452-4c27-9b1b-5d5c4fcb39ac None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.442282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50bde-2452-4c27-9b1b-5d5c4fcb39ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.491785 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-74b50bde-2452-4c27-9b1b-5d5c4fcb39ac None None] MFA Rules not processed for user `79a68935bb7d41c793a288bce7fe7223`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:32:32.493296 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-74b50bde-2452-4c27-9b1b-5d5c4fcb39ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:32:32.539806 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:32.564878 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 551/1121] 10.222.0.47 () {58 vars in 1061 bytes} [Mon Jul 25 20:32:32 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:32:32.574740 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2628ae1-e248-4a0a-89fa-472461e1df1e None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:32.588456 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2628ae1-e248-4a0a-89fa-472461e1df1e None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:32.592794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92400543-17f0-4ab7-be89-e907a133f405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68935bb7d41c793a288bce7fe7223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:32.593440 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400543-17f0-4ab7-be89-e907a133f405 service cinder] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.593923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400543-17f0-4ab7-be89-e907a133f405 service cinder] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.594213 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400543-17f0-4ab7-be89-e907a133f405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.605354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92400543-17f0-4ab7-be89-e907a133f405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:32.606831 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92400543-17f0-4ab7-be89-e907a133f405 service cinder] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:32.618899 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 571/1122] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:32:32 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:32:32.676532 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800afb1-03f3-40bf-bdcf-ebeb1dc95771 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.677208 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800afb1-03f3-40bf-bdcf-ebeb1dc95771 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.678198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800afb1-03f3-40bf-bdcf-ebeb1dc95771 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.680682 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 552/1123] 10.222.0.47 () {52 vars in 830 bytes} [Mon Jul 25 20:32:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:32:32.686426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92400543-17f0-4ab7-be89-e907a133f405 service cinder] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:32.801464 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92400543-17f0-4ab7-be89-e907a133f405 service cinder] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:32.809872 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:32.810998 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:32.811489 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:32.811984 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] PATH_INFO: `/v3/users/ef463e00110b467bae8499ac46920ef2` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:32.814237 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef463e00110b467bae8499ac46920ef2)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:32.816216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING py.warnings [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:32:32.816216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: warnings.warn(msg) Jul 25 20:32:32.816216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: Jul 25 20:32:32.819572 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:32.954053 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef463e00110b467bae8499ac46920ef2'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:32.981965 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef463e00110b467bae8499ac46920ef2'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:32.983286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef463e00110b467bae8499ac46920ef2'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:32.984127 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef463e00110b467bae8499ac46920ef2'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:32.997213 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef463e00110b467bae8499ac46920ef2'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:33.020246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:33.036867 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 572/1124] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 20:32:32 2022] DELETE /identity/v3/users/ef463e00110b467bae8499ac46920ef2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:32:33.044385 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ae7c-e3e8-4415-9c53-b8b235d478f5 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:33.044742 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ae7c-e3e8-4415-9c53-b8b235d478f5 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:33.045236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ae7c-e3e8-4415-9c53-b8b235d478f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:33.072612 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-bfa1ae7c-e3e8-4415-9c53-b8b235d478f5 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:32:33.075052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-bfa1ae7c-e3e8-4415-9c53-b8b235d478f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:32:33.189245 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 553/1125] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:32:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:32:33.201513 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:33.203141 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:32:33.297214 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bef1d-48ee-4cc9-8e4d-eeece802b28a admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:33.302577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08ff7-99d7-4238-876e-b7520386e76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:33.303274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08ff7-99d7-4238-876e-b7520386e76e service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:33.303585 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08ff7-99d7-4238-876e-b7520386e76e service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:33.303863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08ff7-99d7-4238-876e-b7520386e76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:33.314741 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08ff7-99d7-4238-876e-b7520386e76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:33.316284 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08ff7-99d7-4238-876e-b7520386e76e service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:33.327735 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 573/1126] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:32:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:32:33.742959 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1ae7c-e3e8-4415-9c53-b8b235d478f5 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:32:33.745459 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-bfa1ae7c-e3e8-4415-9c53-b8b235d478f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:32:33.764192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1ae7c-e3e8-4415-9c53-b8b235d478f5 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:32:33.773169 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:32:33.773855 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:32:33.774135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:32:33.774410 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] PATH_INFO: `/v3/projects/a91c1463a4964e78a52c3ebc9fc40da3` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:32:33.775766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91c1463a4964e78a52c3ebc9fc40da3)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:32:33.777018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING py.warnings [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:32:33.777018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: warnings.warn(msg) Jul 25 20:32:33.777018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: Jul 25 20:32:33.778280 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:32:33.863113 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91c1463a4964e78a52c3ebc9fc40da3', 'request_id': 'req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:33.876429 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91c1463a4964e78a52c3ebc9fc40da3', 'request_id': 'req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:33.885871 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91c1463a4964e78a52c3ebc9fc40da3', 'request_id': 'req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:33.907114 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] The token cache is being invalidate because project a91c1463a4964e78a52c3ebc9fc40da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 20:32:33.907398 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:33.908219 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-ba4e502c-a6d7-46bb-b74c-a3aa951e4bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:32:33.909973 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 554/1127] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 20:32:33 2022] DELETE /identity/v3/projects/a91c1463a4964e78a52c3ebc9fc40da3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:32:43.323208 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:DELETE=1,keystone:SELECT=33 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:43.903686 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:06.823724 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a78cd-759c-473e-a909-e9fae0b05f05 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:06.824656 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a78cd-759c-473e-a909-e9fae0b05f05 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:06.824656 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a78cd-759c-473e-a909-e9fae0b05f05 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:06.826137 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 574/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:06.832839 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e7ff-f9e0-4f5b-9226-691fdc98937f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:06.833773 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e7ff-f9e0-4f5b-9226-691fdc98937f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:06.833773 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e7ff-f9e0-4f5b-9226-691fdc98937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:06.868990 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-3984e7ff-f9e0-4f5b-9226-691fdc98937f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:06.871452 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-3984e7ff-f9e0-4f5b-9226-691fdc98937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:07.010208 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 555/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:34:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:34:07.327280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a78cd-759c-473e-a909-e9fae0b05f05 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:07.331334 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-5d6a78cd-759c-473e-a909-e9fae0b05f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:07.493950 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a78cd-759c-473e-a909-e9fae0b05f05 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:07.500214 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0792a1-82cb-4be0-8f89-cf61a892f7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:07.501387 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0792a1-82cb-4be0-8f89-cf61a892f7aa service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:07.501940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0792a1-82cb-4be0-8f89-cf61a892f7aa service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:07.502436 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0792a1-82cb-4be0-8f89-cf61a892f7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:07.518799 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0792a1-82cb-4be0-8f89-cf61a892f7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:07.521968 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0792a1-82cb-4be0-8f89-cf61a892f7aa service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:07.538116 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 575/1130] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:34:08.676221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91789a-4da7-42e9-ad01-f28a94af5264 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:08.677164 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91789a-4da7-42e9-ad01-f28a94af5264 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:08.677164 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91789a-4da7-42e9-ad01-f28a94af5264 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:08.679986 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 556/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:34:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:08.688926 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983193b-8fdd-4ed5-9635-d777d071611f None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:08.689853 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983193b-8fdd-4ed5-9635-d777d071611f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:08.689853 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983193b-8fdd-4ed5-9635-d777d071611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:08.723131 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-6983193b-8fdd-4ed5-9635-d777d071611f None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:08.725375 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-6983193b-8fdd-4ed5-9635-d777d071611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:08.740678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 576/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:34:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:34:08.950357 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91789a-4da7-42e9-ad01-f28a94af5264 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:08.978100 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91789a-4da7-42e9-ad01-f28a94af5264 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:08.988636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52256a-cdd0-4e29-a98b-a0262d02bdfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:08.990062 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52256a-cdd0-4e29-a98b-a0262d02bdfe service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:08.990569 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52256a-cdd0-4e29-a98b-a0262d02bdfe service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:08.991108 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52256a-cdd0-4e29-a98b-a0262d02bdfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:09.010120 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52256a-cdd0-4e29-a98b-a0262d02bdfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:09.013739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52256a-cdd0-4e29-a98b-a0262d02bdfe service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:09.032621 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 557/1133] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:34:12.370891 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fec11-8746-4076-aae4-621a9a32687c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:12.371714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fec11-8746-4076-aae4-621a9a32687c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:12.371714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fec11-8746-4076-aae4-621a9a32687c None None] PATH_INFO: `/v3` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:12.373438 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 577/1134] 10.222.0.74 () {54 vars in 925 bytes} [Mon Jul 25 20:34:12 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:34:12.381293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb86ea-7422-44de-b4c1-7800bfdb5780 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:12.382135 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb86ea-7422-44de-b4c1-7800bfdb5780 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:12.382293 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb86ea-7422-44de-b4c1-7800bfdb5780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:12.410940 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-eedb86ea-7422-44de-b4c1-7800bfdb5780 None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:12.413725 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-eedb86ea-7422-44de-b4c1-7800bfdb5780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:12.506418 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 558/1135] 10.222.0.74 () {58 vars in 1015 bytes} [Mon Jul 25 20:34:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:34:16.736274 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323568-4c5e-4152-aa97-bd4491c8aaef None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:16.737167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323568-4c5e-4152-aa97-bd4491c8aaef None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:16.737167 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323568-4c5e-4152-aa97-bd4491c8aaef None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:16.739923 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 578/1136] 10.222.0.47 () {54 vars in 961 bytes} [Mon Jul 25 20:34:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:16.745989 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa722-c801-4cbe-a87f-0f313c89138a None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:16.746537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa722-c801-4cbe-a87f-0f313c89138a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:16.746537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa722-c801-4cbe-a87f-0f313c89138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:16.775470 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-d50aa722-c801-4cbe-a87f-0f313c89138a None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:16.779216 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-d50aa722-c801-4cbe-a87f-0f313c89138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:16.794577 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 559/1137] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Jul 25 20:34:16 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:34:16.804164 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3323568-4c5e-4152-aa97-bd4491c8aaef None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:16.829905 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3323568-4c5e-4152-aa97-bd4491c8aaef None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:16.838295 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8590b-9c52-4176-94e4-1690c83076fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e44d14442bf41598e92099a4bd9ace2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:16.839421 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8590b-9c52-4176-94e4-1690c83076fe service placement] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:16.839706 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8590b-9c52-4176-94e4-1690c83076fe service placement] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:16.839985 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8590b-9c52-4176-94e4-1690c83076fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:16.853357 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8590b-9c52-4176-94e4-1690c83076fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:16.855055 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8590b-9c52-4176-94e4-1690c83076fe service placement] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:16.869304 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 579/1138] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:16 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:34:20.388230 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91a9c2-e022-4281-b839-94192ff667eb None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:20.388835 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91a9c2-e022-4281-b839-94192ff667eb None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:20.388835 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91a9c2-e022-4281-b839-94192ff667eb None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:20.390354 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 560/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:20.396809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c010cc-fd0a-4692-989e-b16f20400d3c None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:20.397408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c010cc-fd0a-4692-989e-b16f20400d3c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:20.397408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c010cc-fd0a-4692-989e-b16f20400d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:20.422401 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-34c010cc-fd0a-4692-989e-b16f20400d3c None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:20.423631 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-34c010cc-fd0a-4692-989e-b16f20400d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:20.432155 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 580/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:34:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:34:20.641586 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91a9c2-e022-4281-b839-94192ff667eb None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:20.667277 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91a9c2-e022-4281-b839-94192ff667eb None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:20.676298 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f430670-dde6-4a3d-8e61-2bdd675510c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:20.678409 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f430670-dde6-4a3d-8e61-2bdd675510c3 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:20.678409 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f430670-dde6-4a3d-8e61-2bdd675510c3 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:20.678409 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f430670-dde6-4a3d-8e61-2bdd675510c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:20.695570 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f430670-dde6-4a3d-8e61-2bdd675510c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:20.698934 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f430670-dde6-4a3d-8e61-2bdd675510c3 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:20.721759 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 561/1141] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:34:21.691473 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899af625-550c-4d7f-aa7e-e23af66a6b08 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:21.692150 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899af625-550c-4d7f-aa7e-e23af66a6b08 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:21.692345 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899af625-550c-4d7f-aa7e-e23af66a6b08 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:21.694855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 581/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 20:34:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:21.703276 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbbffc-f37a-42d9-a1a1-6f09e0f9070d None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:21.703916 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbbffc-f37a-42d9-a1a1-6f09e0f9070d None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:21.704067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbbffc-f37a-42d9-a1a1-6f09e0f9070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:21.730127 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-15dbbffc-f37a-42d9-a1a1-6f09e0f9070d None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:21.731400 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-15dbbffc-f37a-42d9-a1a1-6f09e0f9070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:21.740682 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 562/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 20:34:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:34:21.911574 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899af625-550c-4d7f-aa7e-e23af66a6b08 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:21.929539 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899af625-550c-4d7f-aa7e-e23af66a6b08 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:21.935336 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c3a8d-26ab-4c47-8e8d-16b96020f150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:21.936052 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c3a8d-26ab-4c47-8e8d-16b96020f150 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:21.936438 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c3a8d-26ab-4c47-8e8d-16b96020f150 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:21.936774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c3a8d-26ab-4c47-8e8d-16b96020f150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:21.947023 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c3a8d-26ab-4c47-8e8d-16b96020f150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:21.948717 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c3a8d-26ab-4c47-8e8d-16b96020f150 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:21.961716 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 582/1144] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:34:26.650860 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22422ba8-323b-42d3-be8c-a340ffe83746 None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:26.651467 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22422ba8-323b-42d3-be8c-a340ffe83746 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:26.651627 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22422ba8-323b-42d3-be8c-a340ffe83746 None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:26.653968 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 563/1145] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:34:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:26.661341 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d3c4-7f36-477a-9bf2-a85da2422730 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:26.662289 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d3c4-7f36-477a-9bf2-a85da2422730 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:26.662289 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d3c4-7f36-477a-9bf2-a85da2422730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:26.684885 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-c370d3c4-7f36-477a-9bf2-a85da2422730 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:26.686257 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-c370d3c4-7f36-477a-9bf2-a85da2422730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:26.697919 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 583/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:34:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:34:26.741841 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22422ba8-323b-42d3-be8c-a340ffe83746 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:26.744905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-22422ba8-323b-42d3-be8c-a340ffe83746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:26.834801 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22422ba8-323b-42d3-be8c-a340ffe83746 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:26.839332 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c586-feac-47bb-a550-fa9e3df38567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:26.840019 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c586-feac-47bb-a550-fa9e3df38567 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:26.840337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c586-feac-47bb-a550-fa9e3df38567 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:26.840656 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c586-feac-47bb-a550-fa9e3df38567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:26.852912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4c586-feac-47bb-a550-fa9e3df38567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:26.854694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4c586-feac-47bb-a550-fa9e3df38567 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:26.861421 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:26.869822 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 564/1147] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:34:29.621662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4297e0-b943-4b74-ade2-e091988da6fc None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:29.622561 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4297e0-b943-4b74-ade2-e091988da6fc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:29.622561 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4297e0-b943-4b74-ade2-e091988da6fc None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:29.623842 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 584/1148] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:29.632472 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81e763-e5b9-4e0d-86ea-00ecbb4e2c38 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:29.633417 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81e763-e5b9-4e0d-86ea-00ecbb4e2c38 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:29.633565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81e763-e5b9-4e0d-86ea-00ecbb4e2c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:29.657155 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-4a81e763-e5b9-4e0d-86ea-00ecbb4e2c38 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:29.658426 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-4a81e763-e5b9-4e0d-86ea-00ecbb4e2c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:29.667978 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 565/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:34:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:34:29.720689 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4297e0-b943-4b74-ade2-e091988da6fc None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:29.735292 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4297e0-b943-4b74-ade2-e091988da6fc None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:29.739216 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32ab22-652a-4a84-a5ce-9d8700d167fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:29.739909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ab22-652a-4a84-a5ce-9d8700d167fd service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:29.740291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ab22-652a-4a84-a5ce-9d8700d167fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:29.740646 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ab22-652a-4a84-a5ce-9d8700d167fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:29.752121 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32ab22-652a-4a84-a5ce-9d8700d167fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:29.754002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32ab22-652a-4a84-a5ce-9d8700d167fd service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:29.779964 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 585/1150] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:34:34.106339 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f0a1-6aa8-422a-8569-c3f7e521b40b None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:34.106894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f0a1-6aa8-422a-8569-c3f7e521b40b None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:34.106894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f0a1-6aa8-422a-8569-c3f7e521b40b None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:34.108896 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 566/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:34.115743 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca631a-f1b0-4672-81e9-806769e7aafc None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:34.116281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca631a-f1b0-4672-81e9-806769e7aafc None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:34.116281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca631a-f1b0-4672-81e9-806769e7aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:34.128860 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=65 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:34.144078 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-88ca631a-f1b0-4672-81e9-806769e7aafc None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:34.145356 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-88ca631a-f1b0-4672-81e9-806769e7aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:34.153452 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 586/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:34:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:34:34.467360 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5f0a1-6aa8-422a-8569-c3f7e521b40b None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:34.469915 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-75b5f0a1-6aa8-422a-8569-c3f7e521b40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:34.540312 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5f0a1-6aa8-422a-8569-c3f7e521b40b None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:34.544103 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3dd9-59a6-484e-95be-19c326f085a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68935bb7d41c793a288bce7fe7223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:34.544734 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3dd9-59a6-484e-95be-19c326f085a5 service cinder] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:34.545020 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3dd9-59a6-484e-95be-19c326f085a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:34.545405 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3dd9-59a6-484e-95be-19c326f085a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:34.556650 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3dd9-59a6-484e-95be-19c326f085a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:34.558166 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3dd9-59a6-484e-95be-19c326f085a5 service cinder] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:34.570998 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 567/1153] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:34:37.176822 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b3c8-adb4-4739-af7e-11eab2c1c64e None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:37.177491 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b3c8-adb4-4739-af7e-11eab2c1c64e None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:37.177801 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87b3c8-adb4-4739-af7e-11eab2c1c64e None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:37.180461 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 587/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 20:34:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:34:37.188462 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4695624-d6c2-4763-b282-644c57b8cafa None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:37.189178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4695624-d6c2-4763-b282-644c57b8cafa None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:37.189488 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4695624-d6c2-4763-b282-644c57b8cafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:37.219657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-b4695624-d6c2-4763-b282-644c57b8cafa None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:34:37.221052 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-b4695624-d6c2-4763-b282-644c57b8cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:37.231008 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 568/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 20:34:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:34:37.526702 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b3c8-adb4-4739-af7e-11eab2c1c64e None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:34:37.528526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4e87b3c8-adb4-4739-af7e-11eab2c1c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:34:37.543789 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87b3c8-adb4-4739-af7e-11eab2c1c64e None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:34:37.548438 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17e769-2338-4388-9fe5-34128206ad75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68935bb7d41c793a288bce7fe7223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:34:37.549170 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17e769-2338-4388-9fe5-34128206ad75 service cinder] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:34:37.549734 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17e769-2338-4388-9fe5-34128206ad75 service cinder] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:34:37.549933 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17e769-2338-4388-9fe5-34128206ad75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:34:37.560451 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17e769-2338-4388-9fe5-34128206ad75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:34:37.562261 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17e769-2338-4388-9fe5-34128206ad75 service cinder] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:34:37.576246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 588/1156] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:34:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:34:47.212954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=32 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:47.570875 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=8 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:09.794501 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae728-b69b-4c40-8ec2-58cefe53900a None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:09.795426 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae728-b69b-4c40-8ec2-58cefe53900a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:09.795426 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae728-b69b-4c40-8ec2-58cefe53900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:09.828457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-32bae728-b69b-4c40-8ec2-58cefe53900a None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:09.830744 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-32bae728-b69b-4c40-8ec2-58cefe53900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:09.844319 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 569/1157] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:36:09.854849 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaccbf2-56fd-40c0-a601-18161a7bac29 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:09.855830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaccbf2-56fd-40c0-a601-18161a7bac29 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:09.855830 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaccbf2-56fd-40c0-a601-18161a7bac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:09.859590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f030b-2fa2-4734-b494-28ea3a70299e None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:09.860448 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f030b-2fa2-4734-b494-28ea3a70299e None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:09.861058 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f030b-2fa2-4734-b494-28ea3a70299e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:09.890376 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-0aaccbf2-56fd-40c0-a601-18161a7bac29 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:09.891668 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-0aaccbf2-56fd-40c0-a601-18161a7bac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:09.896912 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-001f030b-2fa2-4734-b494-28ea3a70299e None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:09.899183 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-001f030b-2fa2-4734-b494-28ea3a70299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:09.904069 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 589/1158] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:09.910894 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaccbf2-56fd-40c0-a601-18161a7bac29 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:09.914805 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 570/1159] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:09.923630 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaccbf2-56fd-40c0-a601-18161a7bac29 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:09.925473 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820db9-05c5-4d50-840f-93d05cdc6841 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:09.925824 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820db9-05c5-4d50-840f-93d05cdc6841 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:09.926093 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820db9-05c5-4d50-840f-93d05cdc6841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:09.929714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:09.930501 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:09.931286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:09.931677 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:09.932577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:36:09.932993 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:09.934241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING py.warnings [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:36:09.934241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: warnings.warn(msg) Jul 25 20:36:09.934241 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: Jul 25 20:36:09.935567 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:09.950559 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-c8820db9-05c5-4d50-840f-93d05cdc6841 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:09.951819 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-c8820db9-05c5-4d50-840f-93d05cdc6841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:09.952831 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 590/1160] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Jul 25 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 20:36:09.961007 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 571/1161] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:36:09.966591 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820db9-05c5-4d50-840f-93d05cdc6841 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:09.966922 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:09.978470 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820db9-05c5-4d50-840f-93d05cdc6841 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:09.979969 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7613-ac0a-4922-b38c-c79407cc4f28 admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:09.984430 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:09.985302 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:09.985608 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:09.985848 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:09.986395 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:09.986607 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:09.987350 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:09.987605 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING py.warnings [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:36:09.987605 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: warnings.warn(msg) Jul 25 20:36:09.987605 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: Jul 25 20:36:09.988059 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:09.988291 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:09.989071 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:09.989330 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 20:36:09.989648 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:09.991610 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.011653 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 591/1162] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Jul 25 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 20:36:10.021498 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.033067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 572/1163] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 20:36:09 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:36:10.035911 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006c0dc-bf24-4506-94a9-93059ed9f5f3 admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.040964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.123111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba96f-690b-46cb-a606-5fb7d9c416a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.124230 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba96f-690b-46cb-a606-5fb7d9c416a1 admin admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.124726 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba96f-690b-46cb-a606-5fb7d9c416a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.125281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba96f-690b-46cb-a606-5fb7d9c416a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.126373 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba96f-690b-46cb-a606-5fb7d9c416a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.130254 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba96f-690b-46cb-a606-5fb7d9c416a1 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.143408 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a37637-7883-497a-a717-95a3277eb0d5 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.148849 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7d281-78b9-4c92-81ba-901234dd22b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.149604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7d281-78b9-4c92-81ba-901234dd22b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.150396 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7d281-78b9-4c92-81ba-901234dd22b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.150701 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7d281-78b9-4c92-81ba-901234dd22b8 admin admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.151589 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7d281-78b9-4c92-81ba-901234dd22b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.153887 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7d281-78b9-4c92-81ba-901234dd22b8 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.172552 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 592/1164] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 20:36:10 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:36:10.177588 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba96f-690b-46cb-a606-5fb7d9c416a1 admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.190358 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 573/1165] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:36:10 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:36:10.195668 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7d281-78b9-4c92-81ba-901234dd22b8 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.219629 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7d281-78b9-4c92-81ba-901234dd22b8 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.259362 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba96f-690b-46cb-a606-5fb7d9c416a1 admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.265525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.266226 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.266544 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.266843 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.267614 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.269246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING py.warnings [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:36:10.269246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: warnings.warn(msg) Jul 25 20:36:10.269246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: Jul 25 20:36:10.270099 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.300361 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 593/1166] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:36:10 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:36:10.301629 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.311601 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1047bae-692b-48b9-9c76-9124f8f44328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.313022 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1047bae-692b-48b9-9c76-9124f8f44328 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.313314 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1047bae-692b-48b9-9c76-9124f8f44328 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.313702 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1047bae-692b-48b9-9c76-9124f8f44328 admin admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.313869 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d785-c4bc-448b-a57e-79a4ef1b5e8b admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.315006 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1047bae-692b-48b9-9c76-9124f8f44328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.318196 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1047bae-692b-48b9-9c76-9124f8f44328 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.319388 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f142100-d652-4923-9112-5fa7ddd23f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.320045 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f142100-d652-4923-9112-5fa7ddd23f7e admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.320321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f142100-d652-4923-9112-5fa7ddd23f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.320599 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f142100-d652-4923-9112-5fa7ddd23f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.321875 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f142100-d652-4923-9112-5fa7ddd23f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.323880 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f142100-d652-4923-9112-5fa7ddd23f7e admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.341768 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 594/1167] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 20:36:10.342085 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 574/1168] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:36:10.344079 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f142100-d652-4923-9112-5fa7ddd23f7e admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.345178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1047bae-692b-48b9-9c76-9124f8f44328 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.356327 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f142100-d652-4923-9112-5fa7ddd23f7e admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.363446 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1047bae-692b-48b9-9c76-9124f8f44328 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.365518 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfbb38-1e89-487a-bffb-82a1f07f0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.365518 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfbb38-1e89-487a-bffb-82a1f07f0e2b admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.365518 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfbb38-1e89-487a-bffb-82a1f07f0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.365518 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfbb38-1e89-487a-bffb-82a1f07f0e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.366352 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfbb38-1e89-487a-bffb-82a1f07f0e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.367946 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfbb38-1e89-487a-bffb-82a1f07f0e2b admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.372530 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20012ad2-a538-461e-ae9b-4a1a86a387b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.373288 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012ad2-a538-461e-ae9b-4a1a86a387b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.373651 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012ad2-a538-461e-ae9b-4a1a86a387b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.374191 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012ad2-a538-461e-ae9b-4a1a86a387b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.374957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20012ad2-a538-461e-ae9b-4a1a86a387b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.377005 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20012ad2-a538-461e-ae9b-4a1a86a387b9 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.381804 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 595/1169] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 20:36:10.387944 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfbb38-1e89-487a-bffb-82a1f07f0e2b admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.391032 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 575/1170] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 20:36:10.396861 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20012ad2-a538-461e-ae9b-4a1a86a387b9 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.409365 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20012ad2-a538-461e-ae9b-4a1a86a387b9 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.409972 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfbb38-1e89-487a-bffb-82a1f07f0e2b admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.415507 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856d6fb-1ceb-4ae0-a8be-8d2154dbba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.416199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f331c-a9b2-4377-97a6-0150005c5151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.416440 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856d6fb-1ceb-4ae0-a8be-8d2154dbba56 admin admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.416623 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856d6fb-1ceb-4ae0-a8be-8d2154dbba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.416956 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856d6fb-1ceb-4ae0-a8be-8d2154dbba56 admin admin] PATH_INFO: `/v3/projects/418c5b74f37e490ea5c7c51f0eafad6b/users/c130c6b89bef4e3d851a1d929981db68/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.417286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f331c-a9b2-4377-97a6-0150005c5151 admin admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.417286 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f331c-a9b2-4377-97a6-0150005c5151 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.417637 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f331c-a9b2-4377-97a6-0150005c5151 admin admin] PATH_INFO: `/v3/projects/4e1367fc06434ebe9c0601946e325f70/users/330744276f434ad4bd2714ad199c2dac/roles/5ec05e28e64d4e4b9db1be2d37af117a` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.439698 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f331c-a9b2-4377-97a6-0150005c5151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1367fc06434ebe9c0601946e325f70, user_id=330744276f434ad4bd2714ad199c2dac, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.444490 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856d6fb-1ceb-4ae0-a8be-8d2154dbba56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418c5b74f37e490ea5c7c51f0eafad6b, user_id=c130c6b89bef4e3d851a1d929981db68, role_id=5ec05e28e64d4e4b9db1be2d37af117a)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.444812 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f331c-a9b2-4377-97a6-0150005c5151 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.447273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING py.warnings [None req-e856d6fb-1ceb-4ae0-a8be-8d2154dbba56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:36:10.447273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: warnings.warn(msg) Jul 25 20:36:10.447273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: Jul 25 20:36:10.451411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:10.452625 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856d6fb-1ceb-4ae0-a8be-8d2154dbba56 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.468604 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 596/1171] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 20:36:10 2022] PUT /identity/v3/projects/4e1367fc06434ebe9c0601946e325f70/users/330744276f434ad4bd2714ad199c2dac/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:36:10.471953 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 576/1172] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 20:36:10 2022] PUT /identity/v3/projects/418c5b74f37e490ea5c7c51f0eafad6b/users/c130c6b89bef4e3d851a1d929981db68/roles/5ec05e28e64d4e4b9db1be2d37af117a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:36:10.476448 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970c726-cf42-462a-b9bc-e93e25fd0c25 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.477694 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970c726-cf42-462a-b9bc-e93e25fd0c25 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.478018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0cbc8-4ff9-4221-8ec1-907c60cfdbd3 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.478754 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0cbc8-4ff9-4221-8ec1-907c60cfdbd3 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.478909 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970c726-cf42-462a-b9bc-e93e25fd0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.479054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0cbc8-4ff9-4221-8ec1-907c60cfdbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.502414 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-a3f0cbc8-4ff9-4221-8ec1-907c60cfdbd3 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:10.503704 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-a3f0cbc8-4ff9-4221-8ec1-907c60cfdbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:10.508579 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:10.512805 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-1970c726-cf42-462a-b9bc-e93e25fd0c25 None None] MFA Rules not processed for user `f0f7e9bbd4e142a7ad92a8b7be39f554`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:10.515008 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-1970c726-cf42-462a-b9bc-e93e25fd0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:10.585381 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 577/1173] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:36:10.598091 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0cbc8-4ff9-4221-8ec1-907c60cfdbd3 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.613801 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 597/1174] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:36:10.630107 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970c726-cf42-462a-b9bc-e93e25fd0c25 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:10.708371 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0cbc8-4ff9-4221-8ec1-907c60cfdbd3 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.714954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f1df-009f-4ca7-abf9-70d3bce95965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.716076 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f1df-009f-4ca7-abf9-70d3bce95965 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.716574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f1df-009f-4ca7-abf9-70d3bce95965 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.717072 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f1df-009f-4ca7-abf9-70d3bce95965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.722615 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970c726-cf42-462a-b9bc-e93e25fd0c25 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:10.727268 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151a8d-db2c-4cc3-b394-e5e72c99bdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:10.728958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151a8d-db2c-4cc3-b394-e5e72c99bdaa service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:10.728958 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151a8d-db2c-4cc3-b394-e5e72c99bdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:10.729406 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151a8d-db2c-4cc3-b394-e5e72c99bdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:10.735941 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98f1df-009f-4ca7-abf9-70d3bce95965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.738858 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98f1df-009f-4ca7-abf9-70d3bce95965 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.740788 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87151a8d-db2c-4cc3-b394-e5e72c99bdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:10.742410 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87151a8d-db2c-4cc3-b394-e5e72c99bdaa service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:10.757514 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 578/1175] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:36:10.758200 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 598/1176] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:36:18.393975 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67138-b3aa-4373-baf5-bfe90c9a379f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:18.395150 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67138-b3aa-4373-baf5-bfe90c9a379f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:18.395696 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67138-b3aa-4373-baf5-bfe90c9a379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:18.456660 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-1ef67138-b3aa-4373-baf5-bfe90c9a379f None None] MFA Rules not processed for user `c130c6b89bef4e3d851a1d929981db68`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:18.458316 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-1ef67138-b3aa-4373-baf5-bfe90c9a379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:18.631177 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 579/1177] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:18.640227 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151a8d-db2c-4cc3-b394-e5e72c99bdaa service neutron] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:18.664299 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151a8d-db2c-4cc3-b394-e5e72c99bdaa service neutron] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:18.676258 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8b12-f705-4fd3-b2e2-a0cc901b4ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:18.677336 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8b12-f705-4fd3-b2e2-a0cc901b4ced admin admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:18.677820 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8b12-f705-4fd3-b2e2-a0cc901b4ced admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:18.678306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8b12-f705-4fd3-b2e2-a0cc901b4ced admin admin] PATH_INFO: `/v3/projects` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:18.680888 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f8b12-f705-4fd3-b2e2-a0cc901b4ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:18.684634 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f8b12-f705-4fd3-b2e2-a0cc901b4ced admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:18.747617 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 599/1178] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 20:36:18 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:36:18.753168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef67138-b3aa-4373-baf5-bfe90c9a379f None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:18.788429 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef67138-b3aa-4373-baf5-bfe90c9a379f None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:18.855124 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=100 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:18.880609 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1733edb-a024-414d-b706-4662323b0948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:18.881320 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733edb-a024-414d-b706-4662323b0948 admin admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:18.881611 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733edb-a024-414d-b706-4662323b0948 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:18.881894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733edb-a024-414d-b706-4662323b0948 admin admin] PATH_INFO: `/v3/users` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:18.882694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1733edb-a024-414d-b706-4662323b0948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:18.885580 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1733edb-a024-414d-b706-4662323b0948 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:18.926538 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 580/1179] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:36:18 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:36:18.932267 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8b12-f705-4fd3-b2e2-a0cc901b4ced admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:18.979280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8b12-f705-4fd3-b2e2-a0cc901b4ced admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:19.015205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a73a-a453-4c04-b93c-76f0468f4fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:19.016764 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a73a-a453-4c04-b93c-76f0468f4fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:19.020841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a73a-a453-4c04-b93c-76f0468f4fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:19.021380 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a73a-a453-4c04-b93c-76f0468f4fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:19.025327 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100a73a-a453-4c04-b93c-76f0468f4fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:19.038708 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100a73a-a453-4c04-b93c-76f0468f4fb6 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:19.105586 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 600/1180] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:36:19.107592 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1733edb-a024-414d-b706-4662323b0948 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:19.133198 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1733edb-a024-414d-b706-4662323b0948 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:19.166863 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354d5-c101-4f97-9701-baf6b0a94a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:19.168345 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354d5-c101-4f97-9701-baf6b0a94a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:19.169145 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354d5-c101-4f97-9701-baf6b0a94a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:19.169979 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354d5-c101-4f97-9701-baf6b0a94a63 admin admin] PATH_INFO: `/v3/projects/5b3fdd30562a4f8e95de9a8a3cfc4870/users/85d5e189d7144ba9af98d259e5bdd801/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:19.199845 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed354d5-c101-4f97-9701-baf6b0a94a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3fdd30562a4f8e95de9a8a3cfc4870, user_id=85d5e189d7144ba9af98d259e5bdd801, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:19.203390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed354d5-c101-4f97-9701-baf6b0a94a63 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:19.229081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 581/1181] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 20:36:19 2022] PUT /identity/v3/projects/5b3fdd30562a4f8e95de9a8a3cfc4870/users/85d5e189d7144ba9af98d259e5bdd801/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:36:19.229880 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a73a-a453-4c04-b93c-76f0468f4fb6 admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:19.257751 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a73a-a453-4c04-b93c-76f0468f4fb6 admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:19.400125 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4cc3a-8e0b-4bbd-b39a-09b5e2ecb17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:19.401062 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4cc3a-8e0b-4bbd-b39a-09b5e2ecb17c admin admin] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:19.401405 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4cc3a-8e0b-4bbd-b39a-09b5e2ecb17c admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:19.401662 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4cc3a-8e0b-4bbd-b39a-09b5e2ecb17c admin admin] PATH_INFO: `/v3/roles` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:19.402450 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4cc3a-8e0b-4bbd-b39a-09b5e2ecb17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:19.404101 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4cc3a-8e0b-4bbd-b39a-09b5e2ecb17c admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:19.418036 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 601/1182] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:36:19.422702 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354d5-c101-4f97-9701-baf6b0a94a63 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:19.438443 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354d5-c101-4f97-9701-baf6b0a94a63 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:19.454709 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0fcdd-38fc-4458-8792-5d2320508528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:19.455429 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fcdd-38fc-4458-8792-5d2320508528 admin admin] REQUEST_METHOD: `PUT` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:19.455829 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fcdd-38fc-4458-8792-5d2320508528 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:19.456115 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fcdd-38fc-4458-8792-5d2320508528 admin admin] PATH_INFO: `/v3/projects/5b3fdd30562a4f8e95de9a8a3cfc4870/users/85d5e189d7144ba9af98d259e5bdd801/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:19.458830 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0fcdd-38fc-4458-8792-5d2320508528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3fdd30562a4f8e95de9a8a3cfc4870, user_id=85d5e189d7144ba9af98d259e5bdd801, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:19.463128 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0fcdd-38fc-4458-8792-5d2320508528 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:19.478537 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 582/1183] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 20:36:19 2022] PUT /identity/v3/projects/5b3fdd30562a4f8e95de9a8a3cfc4870/users/85d5e189d7144ba9af98d259e5bdd801/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:36:20.133841 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c042-38f9-432b-88ba-6b048949c6ed None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:20.134782 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c042-38f9-432b-88ba-6b048949c6ed None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:20.134782 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c042-38f9-432b-88ba-6b048949c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:20.147776 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:20.202088 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-6508c042-38f9-432b-88ba-6b048949c6ed None None] MFA Rules not processed for user `330744276f434ad4bd2714ad199c2dac`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:20.203654 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-6508c042-38f9-432b-88ba-6b048949c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:20.334343 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 602/1184] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:20 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:20.334884 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0fcdd-38fc-4458-8792-5d2320508528 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:20.476013 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0fcdd-38fc-4458-8792-5d2320508528 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:20.500491 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f569356-b9aa-40b6-b003-cca2688207d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:20.502651 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f569356-b9aa-40b6-b003-cca2688207d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:20.503315 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f569356-b9aa-40b6-b003-cca2688207d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:20.503947 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f569356-b9aa-40b6-b003-cca2688207d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:20.505497 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f569356-b9aa-40b6-b003-cca2688207d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:20.507984 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f569356-b9aa-40b6-b003-cca2688207d0 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:20.574996 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 583/1185] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 20:36:20 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 20:36:20.579451 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c042-38f9-432b-88ba-6b048949c6ed None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:20.595817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c042-38f9-432b-88ba-6b048949c6ed None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:20.730640 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6855d6-37f3-4d57-a7a8-201afd5854ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:20.731589 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6855d6-37f3-4d57-a7a8-201afd5854ae admin admin] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:20.731878 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6855d6-37f3-4d57-a7a8-201afd5854ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:20.732256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6855d6-37f3-4d57-a7a8-201afd5854ae admin admin] PATH_INFO: `/v3/users` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:20.732875 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6855d6-37f3-4d57-a7a8-201afd5854ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:20.736165 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6855d6-37f3-4d57-a7a8-201afd5854ae admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:20.832281 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 603/1186] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 20:36:20 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 20:36:20.838531 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f569356-b9aa-40b6-b003-cca2688207d0 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:20.852662 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f569356-b9aa-40b6-b003-cca2688207d0 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:20.860013 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf65cf8-a558-4f3b-80ca-beb7e61f0e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:20.861164 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf65cf8-a558-4f3b-80ca-beb7e61f0e27 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:20.861998 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf65cf8-a558-4f3b-80ca-beb7e61f0e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:20.862497 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf65cf8-a558-4f3b-80ca-beb7e61f0e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:20.863524 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf65cf8-a558-4f3b-80ca-beb7e61f0e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:20.865767 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf65cf8-a558-4f3b-80ca-beb7e61f0e27 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:20.892195 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6855d6-37f3-4d57-a7a8-201afd5854ae admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:20.902184 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 584/1187] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:36:20.905666 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6855d6-37f3-4d57-a7a8-201afd5854ae admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:20.918560 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ec486-60a3-435e-a047-8a84447fc43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:20.919185 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ec486-60a3-435e-a047-8a84447fc43a admin admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:20.919476 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ec486-60a3-435e-a047-8a84447fc43a admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:20.919762 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ec486-60a3-435e-a047-8a84447fc43a admin admin] PATH_INFO: `/v3/projects/fe768eb0e7934da1848cf8e0951f62a2/users/e6dda4ae36c44cd19e8e94d8a654240e/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:20.961855 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ec486-60a3-435e-a047-8a84447fc43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe768eb0e7934da1848cf8e0951f62a2, user_id=e6dda4ae36c44cd19e8e94d8a654240e, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:20.966978 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ec486-60a3-435e-a047-8a84447fc43a admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:21.007640 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 604/1188] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 20:36:20 2022] PUT /identity/v3/projects/fe768eb0e7934da1848cf8e0951f62a2/users/e6dda4ae36c44cd19e8e94d8a654240e/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:36:21.014340 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf65cf8-a558-4f3b-80ca-beb7e61f0e27 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:21.047794 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf65cf8-a558-4f3b-80ca-beb7e61f0e27 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:21.183583 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2454e-d2ac-48c4-8b23-3e2c72d8dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:21.184776 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2454e-d2ac-48c4-8b23-3e2c72d8dbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:21.185282 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2454e-d2ac-48c4-8b23-3e2c72d8dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:21.185597 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2454e-d2ac-48c4-8b23-3e2c72d8dbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:21.186713 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2454e-d2ac-48c4-8b23-3e2c72d8dbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:21.188631 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2454e-d2ac-48c4-8b23-3e2c72d8dbd2 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:21.222048 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 585/1189] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 20:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 20:36:21.223467 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ec486-60a3-435e-a047-8a84447fc43a admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:21.237896 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ec486-60a3-435e-a047-8a84447fc43a admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:21.256415 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:21.261152 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] REQUEST_METHOD: `PUT` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:21.261574 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:21.261868 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] PATH_INFO: `/v3/projects/fe768eb0e7934da1848cf8e0951f62a2/users/e6dda4ae36c44cd19e8e94d8a654240e/roles/671de95ce54744059ab540d90d3b40ce` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:21.268047 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe768eb0e7934da1848cf8e0951f62a2, user_id=e6dda4ae36c44cd19e8e94d8a654240e, role_id=671de95ce54744059ab540d90d3b40ce)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:21.275059 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:21.313231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 605/1190] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 20:36:21 2022] PUT /identity/v3/projects/fe768eb0e7934da1848cf8e0951f62a2/users/e6dda4ae36c44cd19e8e94d8a654240e/roles/671de95ce54744059ab540d90d3b40ce => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:36:28.161054 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6a54-f85d-467c-9e22-5c459d0c2037 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:28.161939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6a54-f85d-467c-9e22-5c459d0c2037 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:28.161939 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6a54-f85d-467c-9e22-5c459d0c2037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:28.178404 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:28.232150 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-229b6a54-f85d-467c-9e22-5c459d0c2037 None None] MFA Rules not processed for user `85d5e189d7144ba9af98d259e5bdd801`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:28.236412 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-229b6a54-f85d-467c-9e22-5c459d0c2037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:28.386545 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 586/1191] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:28 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:28.410962 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:28.413772 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:28.522472 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:28.596925 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6d56-78f9-400f-8c39-f8f34acae05c admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:28.606817 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5834a66b3514487db2d99bad0d086030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:28.608742 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:28.609411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:28.610149 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:28.800408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:28.804410 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:28.854730 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 606/1192] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:28 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:36:30.416248 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bcc75-dad1-48e9-a44b-3a45b1069b2d None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:30.416784 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bcc75-dad1-48e9-a44b-3a45b1069b2d None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:30.417457 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bcc75-dad1-48e9-a44b-3a45b1069b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:30.485918 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-591bcc75-dad1-48e9-a44b-3a45b1069b2d None None] MFA Rules not processed for user `e6dda4ae36c44cd19e8e94d8a654240e`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:30.488604 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-591bcc75-dad1-48e9-a44b-3a45b1069b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:30.621954 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 587/1193] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:30 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:30.639445 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:30.640968 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:30.659176 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b51760-c5ae-45eb-bae2-6c5ecade865f service glance] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:30.674921 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60adda-cd28-4659-8baf-3bc1f4e3beeb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5834a66b3514487db2d99bad0d086030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:30.676324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60adda-cd28-4659-8baf-3bc1f4e3beeb service glance] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:30.678454 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60adda-cd28-4659-8baf-3bc1f4e3beeb service glance] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:30.678965 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60adda-cd28-4659-8baf-3bc1f4e3beeb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:30.824278 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60adda-cd28-4659-8baf-3bc1f4e3beeb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:30.828199 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60adda-cd28-4659-8baf-3bc1f4e3beeb service glance] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:30.845322 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 607/1194] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:30 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:36:40.612155 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=66 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:40.838526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=61 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:41.840995 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6371c-ab19-4f59-9eca-bcd9638315b9 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:41.841948 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6371c-ab19-4f59-9eca-bcd9638315b9 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:41.842323 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6371c-ab19-4f59-9eca-bcd9638315b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:41.939403 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-4af6371c-ab19-4f59-9eca-bcd9638315b9 None None] MFA Rules not processed for user `330744276f434ad4bd2714ad199c2dac`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:41.940837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-4af6371c-ab19-4f59-9eca-bcd9638315b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:41.963837 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 588/1195] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:36:41 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:42.511549 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df23b5-1cf9-4abe-a8a0-3303620af59c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:42.512355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df23b5-1cf9-4abe-a8a0-3303620af59c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:42.512355 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df23b5-1cf9-4abe-a8a0-3303620af59c None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:42.513754 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 608/1196] 10.222.0.47 () {54 vars in 962 bytes} [Mon Jul 25 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:36:42.528308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a8fa-8115-4828-b9f6-103ebb51adee None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:42.528613 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a8fa-8115-4828-b9f6-103ebb51adee None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:42.528957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a8fa-8115-4828-b9f6-103ebb51adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:42.552326 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-3086a8fa-8115-4828-b9f6-103ebb51adee None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:42.553744 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-3086a8fa-8115-4828-b9f6-103ebb51adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:42.700655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 589/1197] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Jul 25 20:36:42 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:36:42.712129 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca691d-63d8-42b8-be9f-e1c8335ab97f None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:42.712582 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca691d-63d8-42b8-be9f-e1c8335ab97f None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:42.713028 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca691d-63d8-42b8-be9f-e1c8335ab97f None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:42.715895 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 609/1198] 10.222.0.47 () {54 vars in 912 bytes} [Mon Jul 25 20:36:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:36:42.722965 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef678d-2861-446f-974b-702b6505ba8a None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:42.724059 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef678d-2861-446f-974b-702b6505ba8a None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:42.724852 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef678d-2861-446f-974b-702b6505ba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:42.796262 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-60ef678d-2861-446f-974b-702b6505ba8a None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:42.798883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-60ef678d-2861-446f-974b-702b6505ba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:42.824832 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 590/1199] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Jul 25 20:36:42 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:42.838745 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca691d-63d8-42b8-be9f-e1c8335ab97f None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:42.876372 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca691d-63d8-42b8-be9f-e1c8335ab97f None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:42.881785 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1eff-4e80-4c21-a97f-29d26e6b71fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5834a66b3514487db2d99bad0d086030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:42.883096 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1eff-4e80-4c21-a97f-29d26e6b71fa service glance] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:42.883471 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1eff-4e80-4c21-a97f-29d26e6b71fa service glance] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:42.883848 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1eff-4e80-4c21-a97f-29d26e6b71fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:42.897500 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1eff-4e80-4c21-a97f-29d26e6b71fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:42.900350 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1eff-4e80-4c21-a97f-29d26e6b71fa service glance] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:42.929790 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 610/1200] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:42 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:36:43.715565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e76f-d961-4ea0-91d9-13b75275f1dc None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:43.716420 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e76f-d961-4ea0-91d9-13b75275f1dc None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:43.716618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e76f-d961-4ea0-91d9-13b75275f1dc None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:43.719239 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 591/1201] 10.222.0.47 () {54 vars in 912 bytes} [Mon Jul 25 20:36:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:36:43.729717 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7dc2a-b6ea-4516-ae81-abed1aa85709 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:43.730571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7dc2a-b6ea-4516-ae81-abed1aa85709 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:43.730571 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7dc2a-b6ea-4516-ae81-abed1aa85709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:43.772168 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-caa7dc2a-b6ea-4516-ae81-abed1aa85709 None None] MFA Rules not processed for user `c82c5960cd2a459495388eb5fb1b1cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:43.776390 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-caa7dc2a-b6ea-4516-ae81-abed1aa85709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:43.901301 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 611/1202] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Jul 25 20:36:43 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:36:43.923065 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e76f-d961-4ea0-91d9-13b75275f1dc None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:43.926307 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-ec51e76f-d961-4ea0-91d9-13b75275f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:43.955788 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e76f-d961-4ea0-91d9-13b75275f1dc None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:43.961263 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c450892-cf2e-4a69-9231-686b1e13522a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:43.962337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450892-cf2e-4a69-9231-686b1e13522a service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:43.962735 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450892-cf2e-4a69-9231-686b1e13522a service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:43.963337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450892-cf2e-4a69-9231-686b1e13522a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:43.974006 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c450892-cf2e-4a69-9231-686b1e13522a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:43.975682 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c450892-cf2e-4a69-9231-686b1e13522a service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:43.989549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 592/1203] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:43 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:36:44.643021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662286f-134b-4717-9555-ccfba233d458 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:44.643811 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662286f-134b-4717-9555-ccfba233d458 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:44.644435 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662286f-134b-4717-9555-ccfba233d458 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:44.646565 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 612/1204] 10.222.0.47 () {54 vars in 962 bytes} [Mon Jul 25 20:36:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:36:44.655431 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1130c7-68fa-4f6f-b079-4f439cb92e64 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:44.656094 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1130c7-68fa-4f6f-b079-4f439cb92e64 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:44.656558 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1130c7-68fa-4f6f-b079-4f439cb92e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:44.665268 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37cb9-9dff-435c-a6bf-edebfd2383f6 None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:44.666310 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37cb9-9dff-435c-a6bf-edebfd2383f6 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:44.666984 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37cb9-9dff-435c-a6bf-edebfd2383f6 None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:44.670581 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 613/1205] 10.222.0.47 () {54 vars in 961 bytes} [Mon Jul 25 20:36:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:36:44.678013 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d58bc-50b5-43fa-8dde-649362958eaa None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:44.678915 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d58bc-50b5-43fa-8dde-649362958eaa None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:44.679848 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d58bc-50b5-43fa-8dde-649362958eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:44.683081 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-0f1130c7-68fa-4f6f-b079-4f439cb92e64 None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:44.684920 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-0f1130c7-68fa-4f6f-b079-4f439cb92e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:44.705399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 593/1206] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Jul 25 20:36:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:44.707896 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224e276-923f-4dbd-9021-700196f911ff None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:44.708530 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224e276-923f-4dbd-9021-700196f911ff None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:44.708840 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224e276-923f-4dbd-9021-700196f911ff None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:44.710955 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 594/1207] 10.222.0.47 () {54 vars in 912 bytes} [Mon Jul 25 20:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:36:44.716772 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338e92-43d5-47cc-b5de-2bb07c340c0b None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:44.717882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338e92-43d5-47cc-b5de-2bb07c340c0b None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:44.717882 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15338e92-43d5-47cc-b5de-2bb07c340c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:44.727902 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-a57d58bc-50b5-43fa-8dde-649362958eaa None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:44.729860 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-a57d58bc-50b5-43fa-8dde-649362958eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:44.741388 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-15338e92-43d5-47cc-b5de-2bb07c340c0b None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:44.742963 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-15338e92-43d5-47cc-b5de-2bb07c340c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:44.752630 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 595/1208] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Jul 25 20:36:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:36:44.768197 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15338e92-43d5-47cc-b5de-2bb07c340c0b None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:44.791541 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15338e92-43d5-47cc-b5de-2bb07c340c0b None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:44.799332 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d95d8-bac7-4cd1-bebf-1b2a96ea7aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:44.800358 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d95d8-bac7-4cd1-bebf-1b2a96ea7aef service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:44.801463 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d95d8-bac7-4cd1-bebf-1b2a96ea7aef service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:44.802259 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d95d8-bac7-4cd1-bebf-1b2a96ea7aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:44.826308 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d95d8-bac7-4cd1-bebf-1b2a96ea7aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:44.828969 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d95d8-bac7-4cd1-bebf-1b2a96ea7aef service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:44.844904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 614/1209] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Jul 25 20:36:44 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:44.852460 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 596/1210] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:36:44.858120 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d58bc-50b5-43fa-8dde-649362958eaa None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:44.872147 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d58bc-50b5-43fa-8dde-649362958eaa None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:44.878183 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e44d14442bf41598e92099a4bd9ace2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:44.878898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:44.879262 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:44.879603 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:44.881686 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:44.896097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:44.898678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:44.909960 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 615/1211] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:44 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:36:54.843826 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=53 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:54.905075 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=69 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:56.182044 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c36101-6e1d-46df-a421-aee2aee46cab None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:56.182905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c36101-6e1d-46df-a421-aee2aee46cab None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:56.182905 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c36101-6e1d-46df-a421-aee2aee46cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:56.244749 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-17c36101-6e1d-46df-a421-aee2aee46cab None None] MFA Rules not processed for user `c82c5960cd2a459495388eb5fb1b1cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:56.247192 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-17c36101-6e1d-46df-a421-aee2aee46cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:56.258018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 597/1212] 10.222.0.74 () {58 vars in 1015 bytes} [Mon Jul 25 20:36:56 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:36:56.272492 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:56.298678 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579f1c6-b45f-49c5-91ed-bc14635acf6f service placement] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:56.305526 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f1068-94a6-492d-930c-30ebedbc4baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:56.306832 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f1068-94a6-492d-930c-30ebedbc4baf service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:56.307548 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f1068-94a6-492d-930c-30ebedbc4baf service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:56.308119 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f1068-94a6-492d-930c-30ebedbc4baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:56.321533 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f1068-94a6-492d-930c-30ebedbc4baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:56.323409 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f1068-94a6-492d-930c-30ebedbc4baf service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:56.337005 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 616/1213] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:56 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:36:57.644036 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593fec-ea4a-4e22-9d3f-83d40f2b55dc None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:57.645500 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593fec-ea4a-4e22-9d3f-83d40f2b55dc None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:57.646049 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593fec-ea4a-4e22-9d3f-83d40f2b55dc None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:57.648967 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 598/1214] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 20:36:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:36:57.718354 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b91ce7-fec2-41e4-abaf-3e50979fa103 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:57.719460 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b91ce7-fec2-41e4-abaf-3e50979fa103 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:57.719947 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b91ce7-fec2-41e4-abaf-3e50979fa103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:57.788998 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-97b91ce7-fec2-41e4-abaf-3e50979fa103 None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:36:57.791075 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-97b91ce7-fec2-41e4-abaf-3e50979fa103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:36:57.817487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 617/1215] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 20:36:57 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:36:57.853433 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca593fec-ea4a-4e22-9d3f-83d40f2b55dc None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:36:57.900073 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca593fec-ea4a-4e22-9d3f-83d40f2b55dc None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:36:57.909171 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4571e-5006-4e76-9c4d-64afded1399e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:36:57.910263 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4571e-5006-4e76-9c4d-64afded1399e service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:36:57.910748 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4571e-5006-4e76-9c4d-64afded1399e service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:36:57.911226 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4571e-5006-4e76-9c4d-64afded1399e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:36:57.927521 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4571e-5006-4e76-9c4d-64afded1399e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:36:57.929927 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4571e-5006-4e76-9c4d-64afded1399e service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:36:57.951703 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 599/1216] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:36:57 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:37:04.852210 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991f85-16e1-4569-8a6b-60cecb9a284d None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:37:04.853517 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991f85-16e1-4569-8a6b-60cecb9a284d None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:37:04.853517 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991f85-16e1-4569-8a6b-60cecb9a284d None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:37:04.855800 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 618/1217] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 20:37:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:37:04.871475 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79cac7-7255-4901-b68d-e61114f2984f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:37:04.872165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79cac7-7255-4901-b68d-e61114f2984f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:37:04.872937 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79cac7-7255-4901-b68d-e61114f2984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:37:04.922699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-fc79cac7-7255-4901-b68d-e61114f2984f None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:37:04.935657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-fc79cac7-7255-4901-b68d-e61114f2984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:37:04.958018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 600/1218] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 20:37:04 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:37:04.989378 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991f85-16e1-4569-8a6b-60cecb9a284d None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:37:05.011809 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991f85-16e1-4569-8a6b-60cecb9a284d None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:37:05.019353 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bf2ca-01b7-46f4-a8a1-0c77a1c5c1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:37:05.020150 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf2ca-01b7-46f4-a8a1-0c77a1c5c1a2 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:37:05.020500 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf2ca-01b7-46f4-a8a1-0c77a1c5c1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:37:05.020819 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf2ca-01b7-46f4-a8a1-0c77a1c5c1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:37:05.040403 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bf2ca-01b7-46f4-a8a1-0c77a1c5c1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:37:05.043547 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bf2ca-01b7-46f4-a8a1-0c77a1c5c1a2 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:37:05.067205 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 619/1219] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:37:04 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:37:14.912254 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=12 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:15.056791 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=19 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:20.180290 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79cac7-7255-4901-b68d-e61114f2984f None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:37:20.218696 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79cac7-7255-4901-b68d-e61114f2984f None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:37:20.225900 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c01b87-cdeb-4639-b940-1b08f322316b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:37:20.227087 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01b87-cdeb-4639-b940-1b08f322316b service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:37:20.227663 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01b87-cdeb-4639-b940-1b08f322316b service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:37:20.227910 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01b87-cdeb-4639-b940-1b08f322316b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:37:20.256506 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01b87-cdeb-4639-b940-1b08f322316b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:37:20.262055 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01b87-cdeb-4639-b940-1b08f322316b service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:37:20.282445 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 601/1220] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:37:20 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:37:30.273959 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=10 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:54.786996 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42c45-006d-4019-8741-7d8a55bf3947 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:37:54.787781 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42c45-006d-4019-8741-7d8a55bf3947 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:37:54.787781 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42c45-006d-4019-8741-7d8a55bf3947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:37:54.811941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-6fd42c45-006d-4019-8741-7d8a55bf3947 None None] MFA Rules not processed for user `c130c6b89bef4e3d851a1d929981db68`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:37:54.813954 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-6fd42c45-006d-4019-8741-7d8a55bf3947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:37:54.824729 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 620/1221] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:37:54 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:38:04.805746 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:21.621176 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23921-08b4-4ac2-990b-f0a227cecaab None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:38:21.622048 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23921-08b4-4ac2-990b-f0a227cecaab None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:38:21.622048 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23921-08b4-4ac2-990b-f0a227cecaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:38:21.648445 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-87f23921-08b4-4ac2-990b-f0a227cecaab None None] MFA Rules not processed for user `c130c6b89bef4e3d851a1d929981db68`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:38:21.651930 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-87f23921-08b4-4ac2-990b-f0a227cecaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:38:21.665974 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 602/1222] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:38:21 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:38:22.097727 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603558a-a5e2-46e4-85cb-a7eef4c3efd1 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:38:22.098562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603558a-a5e2-46e4-85cb-a7eef4c3efd1 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:38:22.098562 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603558a-a5e2-46e4-85cb-a7eef4c3efd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:38:22.147616 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-c603558a-a5e2-46e4-85cb-a7eef4c3efd1 None None] MFA Rules not processed for user `c82c5960cd2a459495388eb5fb1b1cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:38:22.149037 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-c603558a-a5e2-46e4-85cb-a7eef4c3efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:38:22.156898 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 621/1223] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Jul 25 20:38:22 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:38:22.172165 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f23921-08b4-4ac2-990b-f0a227cecaab None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:38:22.184407 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f23921-08b4-4ac2-990b-f0a227cecaab None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:38:22.192493 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb06394-51a3-4193-b2cd-b2e71e5379b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:38:22.193179 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb06394-51a3-4193-b2cd-b2e71e5379b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:38:22.193511 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb06394-51a3-4193-b2cd-b2e71e5379b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:38:22.193843 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb06394-51a3-4193-b2cd-b2e71e5379b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:38:22.202832 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb06394-51a3-4193-b2cd-b2e71e5379b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:38:22.204867 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb06394-51a3-4193-b2cd-b2e71e5379b6 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:38:22.214737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 603/1224] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:38:22 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:38:32.143232 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=9 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:32.210679 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=9 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:37.633364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57b5b-260c-4f57-b58f-bf24297386cf None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:38:37.634211 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57b5b-260c-4f57-b58f-bf24297386cf None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:38:37.634364 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57b5b-260c-4f57-b58f-bf24297386cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:38:37.662002 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-7ad57b5b-260c-4f57-b58f-bf24297386cf None None] MFA Rules not processed for user `c130c6b89bef4e3d851a1d929981db68`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:38:37.663256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-7ad57b5b-260c-4f57-b58f-bf24297386cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:38:37.670306 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 622/1225] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:38:37 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:38:47.656851 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:18.507367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb06394-51a3-4193-b2cd-b2e71e5379b6 service neutron] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:39:18.542221 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb06394-51a3-4193-b2cd-b2e71e5379b6 service neutron] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:39:18.550285 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109da74-dc31-4478-83f4-730091b5d366 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e44d14442bf41598e92099a4bd9ace2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:39:18.551090 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109da74-dc31-4478-83f4-730091b5d366 service placement] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:39:18.551410 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109da74-dc31-4478-83f4-730091b5d366 service placement] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:39:18.551694 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109da74-dc31-4478-83f4-730091b5d366 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:39:18.570351 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109da74-dc31-4478-83f4-730091b5d366 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:39:18.573863 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109da74-dc31-4478-83f4-730091b5d366 service placement] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:39:18.596527 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 604/1226] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:39:18 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:39:28.587636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=10 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:38.780185 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcca3-0665-4d64-8783-13ef6e271fe0 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:39:38.780833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcca3-0665-4d64-8783-13ef6e271fe0 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:39:38.780833 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcca3-0665-4d64-8783-13ef6e271fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:39:38.805206 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-4fcdcca3-0665-4d64-8783-13ef6e271fe0 None None] MFA Rules not processed for user `c130c6b89bef4e3d851a1d929981db68`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:39:38.806558 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4fcdcca3-0665-4d64-8783-13ef6e271fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:39:38.816956 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 623/1227] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:39:38 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:39:48.798872 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:52.269502 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109da74-dc31-4478-83f4-730091b5d366 service placement] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:39:52.287429 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109da74-dc31-4478-83f4-730091b5d366 service placement] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:39:52.294236 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929c7ad-3d5e-4aac-8c2f-68155c8f207f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:39:52.295310 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c7ad-3d5e-4aac-8c2f-68155c8f207f service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:39:52.295864 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c7ad-3d5e-4aac-8c2f-68155c8f207f service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:39:52.296367 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c7ad-3d5e-4aac-8c2f-68155c8f207f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:39:52.356949 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929c7ad-3d5e-4aac-8c2f-68155c8f207f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:39:52.359696 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929c7ad-3d5e-4aac-8c2f-68155c8f207f service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:39:52.380434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 605/1228] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:39:52 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:40:02.370337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=17 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:40:55.214844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1879-83e1-4bdc-998d-73357b9ee64c None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:40:55.215431 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1879-83e1-4bdc-998d-73357b9ee64c None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:40:55.215431 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1879-83e1-4bdc-998d-73357b9ee64c None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:40:55.216937 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 624/1229] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 20:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:40:55.223024 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4f60-ec30-4a0d-90b8-1143c089bf76 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:40:55.223618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4f60-ec30-4a0d-90b8-1143c089bf76 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:40:55.223618 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4f60-ec30-4a0d-90b8-1143c089bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:40:55.462382 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-930b4f60-ec30-4a0d-90b8-1143c089bf76 None None] MFA Rules not processed for user `3f1ec071cc544cad97e00695b093c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:40:55.464655 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-930b4f60-ec30-4a0d-90b8-1143c089bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:40:55.524737 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 606/1230] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 20:40:55 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:40:55.548683 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f1879-83e1-4bdc-998d-73357b9ee64c None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:40:55.573616 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f1879-83e1-4bdc-998d-73357b9ee64c None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:40:55.583399 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31656-c910-42ee-a999-18063342f5b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:40:55.584443 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31656-c910-42ee-a999-18063342f5b2 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:40:55.584908 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31656-c910-42ee-a999-18063342f5b2 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:40:55.585758 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31656-c910-42ee-a999-18063342f5b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:40:55.603774 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c31656-c910-42ee-a999-18063342f5b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:40:55.607248 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c31656-c910-42ee-a999-18063342f5b2 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:40:55.628482 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 625/1231] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:40:55 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:41:05.520476 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=28 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:05.620236 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=6 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:10.217712 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66672493-0f9b-4b5a-9a91-55249b0fc7c6 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:41:10.218610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66672493-0f9b-4b5a-9a91-55249b0fc7c6 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:41:10.218610 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66672493-0f9b-4b5a-9a91-55249b0fc7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:41:10.242043 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-66672493-0f9b-4b5a-9a91-55249b0fc7c6 None None] MFA Rules not processed for user `330744276f434ad4bd2714ad199c2dac`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:41:10.243434 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-66672493-0f9b-4b5a-9a91-55249b0fc7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:41:10.250885 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 607/1232] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:41:10 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:41:20.234928 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:30.404360 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31656-c910-42ee-a999-18063342f5b2 service nova] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:41:30.422411 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31656-c910-42ee-a999-18063342f5b2 service nova] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:41:30.432694 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e142612-6853-43fa-84de-6a16fc8fca81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:41:30.434385 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e142612-6853-43fa-84de-6a16fc8fca81 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:41:30.435111 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e142612-6853-43fa-84de-6a16fc8fca81 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:41:30.435605 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e142612-6853-43fa-84de-6a16fc8fca81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:41:30.454097 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e142612-6853-43fa-84de-6a16fc8fca81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:41:30.458320 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e142612-6853-43fa-84de-6a16fc8fca81 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:41:30.475844 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 626/1233] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:41:30 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:41:40.467741 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=6 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:44.445933 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66672493-0f9b-4b5a-9a91-55249b0fc7c6 None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:41:44.464602 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66672493-0f9b-4b5a-9a91-55249b0fc7c6 None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:41:44.472223 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25405de-4c3e-409d-8d4f-8cb4523f9734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:41:44.473732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25405de-4c3e-409d-8d4f-8cb4523f9734 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:41:44.474284 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25405de-4c3e-409d-8d4f-8cb4523f9734 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:41:44.474654 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25405de-4c3e-409d-8d4f-8cb4523f9734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:41:44.496168 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25405de-4c3e-409d-8d4f-8cb4523f9734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:41:44.500683 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25405de-4c3e-409d-8d4f-8cb4523f9734 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:41:44.520927 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 608/1234] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:41:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:41:54.512510 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=6 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:01.490718 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e142612-6853-43fa-84de-6a16fc8fca81 service nova] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:42:01.509718 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e142612-6853-43fa-84de-6a16fc8fca81 service nova] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:42:01.520408 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b2c2c-e885-4d81-9d9a-7423a586a3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:42:01.521520 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b2c2c-e885-4d81-9d9a-7423a586a3e4 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:42:01.522025 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b2c2c-e885-4d81-9d9a-7423a586a3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:42:01.522511 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b2c2c-e885-4d81-9d9a-7423a586a3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:42:01.538888 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b2c2c-e885-4d81-9d9a-7423a586a3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:42:01.542158 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b2c2c-e885-4d81-9d9a-7423a586a3e4 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:42:01.561823 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 627/1235] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:42:01 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:42:03.179535 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25405de-4c3e-409d-8d4f-8cb4523f9734 service neutron] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:42:03.192827 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25405de-4c3e-409d-8d4f-8cb4523f9734 service neutron] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:42:03.198218 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883d5df-dfe4-4e08-8209-25ee5e10c999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:42:03.199025 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d5df-dfe4-4e08-8209-25ee5e10c999 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:42:03.199391 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d5df-dfe4-4e08-8209-25ee5e10c999 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:42:03.199757 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d5df-dfe4-4e08-8209-25ee5e10c999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:42:03.212273 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883d5df-dfe4-4e08-8209-25ee5e10c999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:42:03.213904 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883d5df-dfe4-4e08-8209-25ee5e10c999 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:42:03.228672 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 609/1236] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:42:03 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:42:05.258439 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b2c2c-e885-4d81-9d9a-7423a586a3e4 service nova] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:42:05.300606 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b2c2c-e885-4d81-9d9a-7423a586a3e4 service nova] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:42:05.322606 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46010-d029-4b07-92b8-77743622e221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:42:05.324256 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46010-d029-4b07-92b8-77743622e221 service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:42:05.324654 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46010-d029-4b07-92b8-77743622e221 service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:42:05.325076 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46010-d029-4b07-92b8-77743622e221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:42:05.341687 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46010-d029-4b07-92b8-77743622e221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:42:05.343586 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46010-d029-4b07-92b8-77743622e221 service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:42:05.369434 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 628/1237] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:42:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:42:07.238565 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9059-c27f-4a9f-9085-997b8c6d7b5f None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:42:07.239437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9059-c27f-4a9f-9085-997b8c6d7b5f None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:42:07.239437 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9059-c27f-4a9f-9085-997b8c6d7b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:42:07.269606 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-0a0e9059-c27f-4a9f-9085-997b8c6d7b5f None None] MFA Rules not processed for user `c130c6b89bef4e3d851a1d929981db68`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:42:07.271876 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-0a0e9059-c27f-4a9f-9085-997b8c6d7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:42:07.285381 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 610/1238] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:42:07 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:42:08.599970 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46010-d029-4b07-92b8-77743622e221 service nova] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:42:08.656470 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46010-d029-4b07-92b8-77743622e221 service nova] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:42:08.669663 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb6825-286a-4314-b466-f0fbc1874b1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e44d14442bf41598e92099a4bd9ace2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:42:08.670758 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb6825-286a-4314-b466-f0fbc1874b1a service placement] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:42:08.671578 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb6825-286a-4314-b466-f0fbc1874b1a service placement] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:42:08.672649 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb6825-286a-4314-b466-f0fbc1874b1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:42:08.695128 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb6825-286a-4314-b466-f0fbc1874b1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:42:08.698449 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb6825-286a-4314-b466-f0fbc1874b1a service placement] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:42:08.707552 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e9059-c27f-4a9f-9085-997b8c6d7b5f None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:42:08.721445 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e9059-c27f-4a9f-9085-997b8c6d7b5f None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:42:08.724904 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 629/1239] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:42:08 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:42:08.725794 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b80de-24ab-41f6-a641-e3722531a732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:42:08.726556 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b80de-24ab-41f6-a641-e3722531a732 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:42:08.726935 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b80de-24ab-41f6-a641-e3722531a732 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:42:08.727376 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b80de-24ab-41f6-a641-e3722531a732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:42:08.736755 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b80de-24ab-41f6-a641-e3722531a732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:42:08.739335 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b80de-24ab-41f6-a641-e3722531a732 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:42:08.749957 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 611/1240] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:42:08 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:42:18.619825 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb6825-286a-4314-b466-f0fbc1874b1a service placement] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:42:18.642760 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb6825-286a-4314-b466-f0fbc1874b1a service placement] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:42:18.654178 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61910b-18ef-453d-a8c7-731e5832e55e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:42:18.655738 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61910b-18ef-453d-a8c7-731e5832e55e service nova] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:42:18.656525 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61910b-18ef-453d-a8c7-731e5832e55e service nova] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:42:18.656848 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61910b-18ef-453d-a8c7-731e5832e55e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:42:18.676522 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61910b-18ef-453d-a8c7-731e5832e55e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:42:18.679759 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61910b-18ef-453d-a8c7-731e5832e55e service nova] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:42:18.699924 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 630/1241] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:42:18 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:42:18.745371 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=15 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:28.691647 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=24 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:07.394018 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b80de-24ab-41f6-a641-e3722531a732 service neutron] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:43:07.404520 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b80de-24ab-41f6-a641-e3722531a732 service neutron] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:43:07.410158 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278ae9d-9abb-4200-a5ce-e0d80d116c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:43:07.410799 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278ae9d-9abb-4200-a5ce-e0d80d116c4a service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:07.411075 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278ae9d-9abb-4200-a5ce-e0d80d116c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:07.411350 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278ae9d-9abb-4200-a5ce-e0d80d116c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:07.521325 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278ae9d-9abb-4200-a5ce-e0d80d116c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:43:07.523607 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278ae9d-9abb-4200-a5ce-e0d80d116c4a service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:43:07.559881 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 612/1242] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:43:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:43:12.843172 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f60eb1-e9b3-4579-9c55-81059a6bc94b None None] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:12.844324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f60eb1-e9b3-4579-9c55-81059a6bc94b None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:12.844324 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f60eb1-e9b3-4579-9c55-81059a6bc94b None None] PATH_INFO: `/` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:12.846995 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 631/1243] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 20:43:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 20:43:13.073607 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49769ca-5d2a-4347-9016-885136ff6df2 None None] REQUEST_METHOD: `POST` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:13.074283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49769ca-5d2a-4347-9016-885136ff6df2 None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:13.074283 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49769ca-5d2a-4347-9016-885136ff6df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:13.129363 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.auth.core [None req-a49769ca-5d2a-4347-9016-885136ff6df2 None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:43:13.131640 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-a49769ca-5d2a-4347-9016-885136ff6df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:43:13.145016 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 613/1244] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 20:43:13 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:43:13.169030 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f60eb1-e9b3-4579-9c55-81059a6bc94b None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:43:13.191228 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f60eb1-e9b3-4579-9c55-81059a6bc94b None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:43:13.198490 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9620876-7175-4a13-aab5-906b2c007207 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e44d14442bf41598e92099a4bd9ace2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:43:13.199160 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9620876-7175-4a13-aab5-906b2c007207 service placement] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:13.199684 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9620876-7175-4a13-aab5-906b2c007207 service placement] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:13.199966 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9620876-7175-4a13-aab5-906b2c007207 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:13.212149 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9620876-7175-4a13-aab5-906b2c007207 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:43:13.213948 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9620876-7175-4a13-aab5-906b2c007207 service placement] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:43:13.228326 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 632/1245] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:43:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:43:17.331885 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e2333-2217-4e2b-8b1b-30e4ad2a3fba None None] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:17.332646 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e2333-2217-4e2b-8b1b-30e4ad2a3fba None None] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:17.332803 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e2333-2217-4e2b-8b1b-30e4ad2a3fba None None] PATH_INFO: `/` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:17.335252 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 614/1246] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 20:43:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 20:43:17.353219 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5900f5-680b-4498-ae64-8a6f9a4506a5 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:17.353822 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5900f5-680b-4498-ae64-8a6f9a4506a5 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:17.354039 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5900f5-680b-4498-ae64-8a6f9a4506a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:17.381588 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-8c5900f5-680b-4498-ae64-8a6f9a4506a5 None None] MFA Rules not processed for user `6e44d14442bf41598e92099a4bd9ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:43:17.382940 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-8c5900f5-680b-4498-ae64-8a6f9a4506a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:43:17.397941 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 633/1247] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 20:43:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 20:43:17.422067 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e2333-2217-4e2b-8b1b-30e4ad2a3fba None None] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:43:17.448940 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e2333-2217-4e2b-8b1b-30e4ad2a3fba None None] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:43:17.451950 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5900f5-680b-4498-ae64-8a6f9a4506a5 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:43:17.458264 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fed436-6e15-4528-aa8c-cca88f645794 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e44d14442bf41598e92099a4bd9ace2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:43:17.459122 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed436-6e15-4528-aa8c-cca88f645794 service placement] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:17.459883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed436-6e15-4528-aa8c-cca88f645794 service placement] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:17.459883 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed436-6e15-4528-aa8c-cca88f645794 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:17.480550 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fed436-6e15-4528-aa8c-cca88f645794 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:43:17.483487 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5900f5-680b-4498-ae64-8a6f9a4506a5 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:43:17.483751 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fed436-6e15-4528-aa8c-cca88f645794 service placement] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:43:17.490674 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:43:17.491703 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:17.492710 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:17.492710 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] PATH_INFO: `/v3/users/330744276f434ad4bd2714ad199c2dac` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:17.494032 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=330744276f434ad4bd2714ad199c2dac)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:43:17.496231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:43:17.499366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 615/1248] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:43:17 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:43:17.582396 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330744276f434ad4bd2714ad199c2dac'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:17.594261 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330744276f434ad4bd2714ad199c2dac'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:17.596121 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330744276f434ad4bd2714ad199c2dac'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:17.596910 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330744276f434ad4bd2714ad199c2dac'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:17.606458 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330744276f434ad4bd2714ad199c2dac'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:17.633321 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 634/1249] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 20:43:17 2022] DELETE /identity/v3/users/330744276f434ad4bd2714ad199c2dac => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:43:17.887603 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fed436-6e15-4528-aa8c-cca88f645794 service placement] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:43:17.910806 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fed436-6e15-4528-aa8c-cca88f645794 service placement] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:43:18.025257 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:43:18.025976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] REQUEST_METHOD: `DELETE` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:18.026222 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:18.026473 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] PATH_INFO: `/v3/projects/4e1367fc06434ebe9c0601946e325f70` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:18.027844 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1367fc06434ebe9c0601946e325f70)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:43:18.029868 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:43:18.096352 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:18.101732 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1367fc06434ebe9c0601946e325f70', 'request_id': 'req-83285c27-1e83-4f48-8716-2ba50f2bcade'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.113729 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1367fc06434ebe9c0601946e325f70', 'request_id': 'req-83285c27-1e83-4f48-8716-2ba50f2bcade'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.123638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1367fc06434ebe9c0601946e325f70', 'request_id': 'req-83285c27-1e83-4f48-8716-2ba50f2bcade'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.158085 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] The token cache is being invalidate because project 4e1367fc06434ebe9c0601946e325f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 20:43:18.158597 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.159390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.161194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 616/1250] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 20:43:17 2022] DELETE /identity/v3/projects/4e1367fc06434ebe9c0601946e325f70 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:43:18.166566 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:43:18.168737 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:43:18.187677 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3677-bb79-4b23-85ab-a8281ccce013 admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:43:18.271237 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:43:18.272297 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:18.272863 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:18.273300 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] PATH_INFO: `/v3/users/e6dda4ae36c44cd19e8e94d8a654240e` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:18.275369 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6dda4ae36c44cd19e8e94d8a654240e)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:43:18.278314 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:43:18.379420 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6dda4ae36c44cd19e8e94d8a654240e'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.394714 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:18.400980 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6dda4ae36c44cd19e8e94d8a654240e'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.402328 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6dda4ae36c44cd19e8e94d8a654240e'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.403395 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6dda4ae36c44cd19e8e94d8a654240e'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.415854 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-46be9b3e-803e-4f3a-8195-34615514d3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6dda4ae36c44cd19e8e94d8a654240e'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.446787 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 635/1251] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 20:43:18 2022] DELETE /identity/v3/users/e6dda4ae36c44cd19e8e94d8a654240e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:43:18.760946 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:43:18.764021 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:43:18.794551 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83285c27-1e83-4f48-8716-2ba50f2bcade admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:43:18.884139 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:43:18.885390 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:43:18.885986 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:43:18.886560 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] PATH_INFO: `/v3/projects/fe768eb0e7934da1848cf8e0951f62a2` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:43:18.889407 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe768eb0e7934da1848cf8e0951f62a2)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:43:18.894549 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:43:18.980567 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe768eb0e7934da1848cf8e0951f62a2', 'request_id': 'req-f8f73829-199b-4286-9613-29d1121c20e8'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:18.994212 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe768eb0e7934da1848cf8e0951f62a2', 'request_id': 'req-f8f73829-199b-4286-9613-29d1121c20e8'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:19.006116 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe768eb0e7934da1848cf8e0951f62a2', 'request_id': 'req-f8f73829-199b-4286-9613-29d1121c20e8'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:19.021909 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] The token cache is being invalidate because project fe768eb0e7934da1848cf8e0951f62a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 20:43:19.022205 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:19.022936 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:43:19.024677 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 617/1252] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 20:43:18 2022] DELETE /identity/v3/projects/fe768eb0e7934da1848cf8e0951f62a2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:43:28.440085 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=9,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:29.017246 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:DELETE=11,keystone:SELECT=63,keystone:INSERT=2 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:11.725960 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac733186-dc19-4a10-94b4-576005dbfbc7 None None] REQUEST_METHOD: `POST` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:44:11.726679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac733186-dc19-4a10-94b4-576005dbfbc7 None None] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:44:11.726679 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac733186-dc19-4a10-94b4-576005dbfbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:44:11.749231 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.auth.core [None req-ac733186-dc19-4a10-94b4-576005dbfbc7 None None] MFA Rules not processed for user `c130c6b89bef4e3d851a1d929981db68`. Rule list: `[]` (Enabled: `True`). {{(pid=87207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 20:44:11.751165 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ac733186-dc19-4a10-94b4-576005dbfbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:44:11.832933 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 636/1253] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 20:44:11 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 20:44:12.498554 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:44:12.501529 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:44:12.622711 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f73829-199b-4286-9613-29d1121c20e8 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:44:12.627638 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:44:12.628361 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:44:12.628698 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:44:12.628976 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:44:12.631524 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:44:12.644206 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:44:12.645619 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:44:12.655803 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 618/1254] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:44:12 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:44:21.824453 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=25 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:22.651087 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=31 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:23.600539 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac733186-dc19-4a10-94b4-576005dbfbc7 None None] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:44:23.601981 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-ac733186-dc19-4a10-94b4-576005dbfbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:44:23.706021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac733186-dc19-4a10-94b4-576005dbfbc7 None None] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:44:23.709391 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e44d14442bf41598e92099a4bd9ace2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:44:23.710110 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:44:23.710400 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:44:23.710709 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:44:23.713082 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:44:23.727554 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:44:23.729260 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:44:23.741483 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 637/1255] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:44:23 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 20:44:33.736426 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=32 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:18.287791 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:46:18.289920 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:46:18.445941 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e62c2-57aa-4cdd-a6f4-f26a993adb47 service neutron] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:46:18.455086 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1ec071cc544cad97e00695b093c0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:46:18.456699 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:46:18.457337 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:46:18.458048 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:46:18.461216 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:46:18.480894 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:46:18.483154 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:46:18.497310 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 619/1256] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:46:18 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:46:28.491721 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=37 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:56.259615 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:46:56.275225 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f3c36-2a17-4ba9-bb73-42d91b4c2d7b service placement] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:46:56.281605 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:46:56.282769 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:46:56.283510 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:46:56.284076 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:46:56.287214 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:46:56.311246 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:46:56.314043 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:46:56.334558 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 638/1257] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:46:56 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:47:02.134366 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:47:02.136346 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:47:02.259708 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b1abc-e751-427b-9310-3b8d4df88b20 service nova] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:47:02.264363 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79a68935bb7d41c793a288bce7fe7223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:47:02.265056 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:47:02.265471 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:47:02.265751 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:47:02.267847 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:47:02.308817 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:47:02.311028 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:47:02.333016 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 620/1258] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:47:02 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:47:02.659625 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:47:02.661235 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:47:02.674208 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d854de-691f-4e7e-8c20-47fd1c039c42 service neutron] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:47:02.678374 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c82c5960cd2a459495388eb5fb1b1cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:47:02.679021 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] REQUEST_METHOD: `GET` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:47:02.679276 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:47:02.679673 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:47:02.681722 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:47:02.765305 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:47:02.766822 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:47:02.777977 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 639/1259] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:47:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:47:11.994983 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:47:11.998485 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:47:12.018371 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d148f9-3436-4d56-8861-d9b389901aae service cinder] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:47:12.024897 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:47:12.025612 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:47:12.025887 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:47:12.026162 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] PATH_INFO: `/v3/users/c130c6b89bef4e3d851a1d929981db68` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:47:12.027574 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c130c6b89bef4e3d851a1d929981db68)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:47:12.029492 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: WARNING py.warnings [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:47:12.029492 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: warnings.warn(msg) Jul 25 20:47:12.029492 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: Jul 25 20:47:12.031006 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:47:12.139590 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c130c6b89bef4e3d851a1d929981db68'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.140692 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c130c6b89bef4e3d851a1d929981db68'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.141427 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c130c6b89bef4e3d851a1d929981db68'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.169864 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c130c6b89bef4e3d851a1d929981db68'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.184988 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c130c6b89bef4e3d851a1d929981db68'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.202739 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 621/1260] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 20:47:11 2022] DELETE /identity/v3/users/c130c6b89bef4e3d851a1d929981db68 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:47:12.452690 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:47:12.471039 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a5711-19f3-4ed6-9639-fdf968704d94 service neutron] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:47:12.578616 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:47:12.579332 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:47:12.579688 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:47:12.580041 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] PATH_INFO: `/v3/projects/418c5b74f37e490ea5c7c51f0eafad6b` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:47:12.581541 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418c5b74f37e490ea5c7c51f0eafad6b)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:47:12.582692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: WARNING py.warnings [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:47:12.582692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: warnings.warn(msg) Jul 25 20:47:12.582692 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: Jul 25 20:47:12.584322 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:47:12.660327 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418c5b74f37e490ea5c7c51f0eafad6b', 'request_id': 'req-4e65cde3-fa4e-4105-aec8-c5f3289196a4'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.670998 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418c5b74f37e490ea5c7c51f0eafad6b', 'request_id': 'req-4e65cde3-fa4e-4105-aec8-c5f3289196a4'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.682239 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418c5b74f37e490ea5c7c51f0eafad6b', 'request_id': 'req-4e65cde3-fa4e-4105-aec8-c5f3289196a4'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.705794 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] The token cache is being invalidate because project 418c5b74f37e490ea5c7c51f0eafad6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 20:47:12.706268 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.706818 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.709011 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 640/1261] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 20:47:12 2022] DELETE /identity/v3/projects/418c5b74f37e490ea5c7c51f0eafad6b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:47:12.714362 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:47:12.716981 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:47:12.741973 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b482ae3-dbbf-4ada-b3c1-9dc59d5b834d admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:47:12.792178 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:12.860525 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:47:12.861689 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:47:12.862176 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:47:12.862589 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] PATH_INFO: `/v3/users/85d5e189d7144ba9af98d259e5bdd801` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:47:12.888578 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d5e189d7144ba9af98d259e5bdd801)` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:47:12.892532 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:47:12.988438 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d5e189d7144ba9af98d259e5bdd801'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.989319 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d5e189d7144ba9af98d259e5bdd801'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:12.989868 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d5e189d7144ba9af98d259e5bdd801'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:13.007399 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d5e189d7144ba9af98d259e5bdd801'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:13.018203 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.notifications [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d5e189d7144ba9af98d259e5bdd801'} {{(pid=87208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:13.036340 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 622/1262] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 20:47:12 2022] DELETE /identity/v3/users/85d5e189d7144ba9af98d259e5bdd801 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 20:47:13.267802 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] Authenticating user token {{(pid=87207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:47:13.270217 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.fernet_utils [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:47:13.295280 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65cde3-fa4e-4105-aec8-c5f3289196a4 admin admin] Validating token access rules against request {{(pid=87207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:47:13.313897 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:13.402298 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0f7e9bbd4e142a7ad92a8b7be39f554', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29a02beb75e24b5ebbb64e25721c9c99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:47:13.404016 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:47:13.404501 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:47:13.405019 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] PATH_INFO: `/v3/projects/5b3fdd30562a4f8e95de9a8a3cfc4870` {{(pid=87207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:47:13.426637 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3fdd30562a4f8e95de9a8a3cfc4870)` {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:47:13.430423 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] RBAC: Authorization granted {{(pid=87207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:47:13.508012 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3fdd30562a4f8e95de9a8a3cfc4870', 'request_id': 'req-48a25efa-41b6-4ac9-a624-d691bf5c45ea'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:13.521960 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3fdd30562a4f8e95de9a8a3cfc4870', 'request_id': 'req-48a25efa-41b6-4ac9-a624-d691bf5c45ea'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:13.531557 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3fdd30562a4f8e95de9a8a3cfc4870', 'request_id': 'req-48a25efa-41b6-4ac9-a624-d691bf5c45ea'} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:13.553882 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] The token cache is being invalidate because project 5b3fdd30562a4f8e95de9a8a3cfc4870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 20:47:13.554400 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:13.555509 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG keystone.notifications [None req-48a25efa-41b6-4ac9-a624-d691bf5c45ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 20:47:13.558198 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: [pid: 87207|app: 0|req: 641/1263] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 20:47:13 2022] DELETE /identity/v3/projects/5b3fdd30562a4f8e95de9a8a3cfc4870 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 20:47:23.031456 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:23.550577 dv-osbrick-849017-3-ceph devstack@keystone.service[87207]: DEBUG dbcounter [-] [87207] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:27.531439 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] Authenticating user token {{(pid=87208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 20:49:27.533766 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:49:27.680657 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8073-c384-4b83-b191-b0849670c3f8 admin admin] Validating token access rules against request {{(pid=87208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 20:49:27.774194 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efd5b5-7252-42e7-8475-d87dd6deff83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e44d14442bf41598e92099a4bd9ace2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcba1bed6cbb44dd8da5613751435133', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 20:49:27.774736 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efd5b5-7252-42e7-8475-d87dd6deff83 service placement] REQUEST_METHOD: `GET` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 20:49:27.775239 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efd5b5-7252-42e7-8475-d87dd6deff83 service placement] SCRIPT_NAME: `/identity` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 20:49:27.775560 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efd5b5-7252-42e7-8475-d87dd6deff83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 20:49:27.777636 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.fernet_utils [None req-e2efd5b5-7252-42e7-8475-d87dd6deff83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 20:49:27.791964 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efd5b5-7252-42e7-8475-d87dd6deff83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 20:49:27.793673 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efd5b5-7252-42e7-8475-d87dd6deff83 service placement] RBAC: Authorization granted {{(pid=87208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 20:49:27.806068 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: [pid: 87208|app: 0|req: 623/1264] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 20:49:27 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 20:49:37.800572 dv-osbrick-849017-3-ceph devstack@keystone.service[87208]: DEBUG dbcounter [-] [87208] Writing DB stats keystone:SELECT=67 {{(pid=87208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}